Cas/ffxiv-datamining
2
0
Fork 0
mirror of https://github.com/xivapi/ffxiv-datamining.git synced 2026-07-24 02:49:10 +00:00
Code Issues Packages Projects Releases Wiki Activity

Big clean up of structure and contents

Browse Source
This commit is contained in:
Josh Freeman
2018-10-03 18:24:44 +01:00
parent 74795df42b
commit 7d434e502b
25 changed files with 185 additions and 140 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+35 -33
View File
@@ -2,13 +2,21 @@
This repository is to serve as a place to share data mining information related to Final Fantasy XIV. All findings and knowledge that each member discovers will be provided here for all in the FFXIV Community to read, learn and use.
Huge thanks to the community team members involved:
# Documents of Knowledge
- [Ioncannon](https://www.reddit.com/user/Ioncannon) from [FFXIV Explorer](http://ffxivexplorer.fragmenterworks.com)
- [Clorifex](https://www.reddit.com/user/Clorifex) from [GarlandTools](http://www.garlandtools.org/db/)
- [Hezkezl](https://www.reddit.com/user/Hezkezl) for being awesome
- [Click here to view Documents on various FFXIV systems](docs/README.md)
## Updating CSV files:
# Research and misc files
- [Click here to view various research and resource files](research/README.md)
# CSVs
This repository keeps a record of CSV's extracted via SaintCoinach using the command `rawexd`, this is so they can be easily linked and referenced when datamining, so we have a git history of changes and just to make life easier in some cases :)
- [Click here to view CSV files](csv/)
### Updating CSV files:
- Download and open **SaintCoinach.cmd**
- Run: `rawexd`
@@ -19,8 +27,29 @@ The idea is to maintain an easy diffing view of what has changed during a patch
It would also be very useful to keep a history of `ex.json` files from SaintCoinach for each patch as the Korean and Chinese versions are on different patches than the Official live client.
### whats the "ex" folder?
## Helping out
Ex contains an archive list of the [SaintCoinach ex.json](https://github.com/ufx/SaintCoinach/blob/master/SaintCoinach/ex.json) file, ths main point was to keep a `ex.json` file per Patch, then if you wanted to extract data from an older patch (such as Korean or Chinese clients) you can hot-swap the `ex.json` file and extract data in the correct format.
This kind of hot swap does not always work however as new structures are detected that are implemented into SaintCoinach, or you may have systems that expect data in a specific way (eg the great "Tooltip Descriptions Changes" of Patch 4.4)** ...
You can just grab an old version from git history, which I may switch to linking to instead of keeping copies.
### whats the "uld" folder?
It's an extract of FFXIV UI Elements (images) extracted from SaintCoinach.
---
### Huge thanks to:
- [Ioncannon](https://www.reddit.com/user/Ioncannon) from [FFXIV Explorer](http://ffxivexplorer.fragmenterworks.com)
- [Clorifex](https://www.reddit.com/user/Clorifex) from [GarlandTools](http://www.garlandtools.org/db/)
- [Hezkezl](https://www.reddit.com/user/Hezkezl) for being awesome
### Becoming a dataminer
Getting started in datamining is quite easy. If you enjoy digging around CSV database files then you've come to the right place! The best place to start would be:
@@ -33,30 +62,3 @@ If you find a connection between files or an identification of data, throw up an
- Connection between files could be an number in 1 column that matches the numbers in another column or even another file
- Identification of data could be values in a column that have a meaning and a pattern can be observed (eg ClassJob ID, or Craft Level)
# The tools of the trade
### Saint Coinach
- Written by: Clorifex and Rogueadyn
- GitHub: https://github.com/ufx/SaintCoinach
- Downloads: https://github.com/ufx/SaintCoinach/releases
- SaintCoinach.Cmd is a tool to rip data (csv, music, icons, maps, etc)
- Godbert is a *viewer* tool to browse data.
A great tool showing really impressive results, it will allow you to view and export a lot of data. The source is all open for your luxery.
---
**Other cool projects**
- REST API: http://xivapi.com/
- (PHP) Lodestone Parser: https://github.com/viion/lodestone-php
- (PHP CLI) Libra exporter: https://github.com/viion/libra-php
- (PHP CLI) Lodestone Icon Ripper: https://github.com/viion/lodestone-icons
- (PHP CLI) SaintCoinach CSV Parser: https://github.com/viion/saint-csv-parser
- (C#) Memory Reader: https://github.com/Icehunter/sharlayan
- (NodeJS) Dead Lodestone Parser: https://github.com/viion/lodestone-nodejs