aboutsummaryrefslogtreecommitdiff
path: root/backend/tolData/wikidata/README.md
blob: db45b3c732ed3d9e61f5e3fa5ef9c9b6796f04b0 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
This directory holds files obtained via [Wikidata](https://www.wikidata.org/).

# Downloaded Files
-   `latest-all.json.bz2` <br>
    Obtained from <https://dumps.wikimedia.org/wikidatawiki/entities/> (on 23/08/22).
    Format info can be found at <https://doc.wikimedia.org/Wikibase/master/php/md_docs_topics_json.html>.

# Other Files
-   genTaxonSrcData.py <br>
    Used to generate a database holding taxon information from the dump.
-   offsets.dat <br>
    Holds bzip2 block offsets for the dump. Generated and used by
    genTaxonSrcData.py for parallel processing of the dump.
-   taxonSrcs.db <br>
    Generated by genTaxonSrcData.py. <br>
    Tables: <br>
    -   `src_id_to_title`: `src TEXT, id INT, title TEXT, PRIMARY KEY(src, id)`
    -   `title_iucn`:      `title TEXT PRIMARY KEY, status TEXT`