aboutsummaryrefslogtreecommitdiff
path: root/backend/tol_data/wikidata/README.md
blob: 7b3105e434e69cf5a9a7493df41764564eabb2b0 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
This directory holds files obtained via [Wikidata](https://www.wikidata.org/).

# Downloaded Files
-   `latest-all.json.bz2` <br>
    Obtained from <https://dumps.wikimedia.org/wikidatawiki/entities/> (on 23/08/22).
    Format info can be found at <https://doc.wikimedia.org/Wikibase/master/php/md_docs_topics_json.html>.

# Other Files
-   `gen_taxon_src_data.py` <br>
    Used to generate a database holding taxon information from the dump.
-   `offsets.dat` <br>
    Holds bzip2 block offsets for the dump. Generated and used by
    genTaxonSrcData.py for parallel processing of the dump.
-   `taxon_srcs.db` <br>
    Generated by `gen_taxon_src_data.py`. <br>
    Tables: <br>
    -   `src_id_to_title`: `src TEXT, id INT, title TEXT, PRIMARY KEY(src, id)`
    -   `title_iucn`:      `title TEXT PRIMARY KEY, status TEXT`