aboutsummaryrefslogtreecommitdiff
path: root/backend/tol_data/eol/README.md
diff options
context:
space:
mode:
Diffstat (limited to 'backend/tol_data/eol/README.md')
-rw-r--r--backend/tol_data/eol/README.md31
1 files changed, 31 insertions, 0 deletions
diff --git a/backend/tol_data/eol/README.md b/backend/tol_data/eol/README.md
new file mode 100644
index 0000000..580310d
--- /dev/null
+++ b/backend/tol_data/eol/README.md
@@ -0,0 +1,31 @@
+This directory holds files obtained via the [Encyclopedia of Life](https://eol.org/).
+
+# Mapping Files
+- `provider_ids.csv.gz` <br>
+ Obtained from <https://opendata.eol.org/dataset/identifier-map> on 22/08/22 (says last updated 27/07/22).
+ Associates EOL IDs with taxon IDs from sources like NCBI and Index Fungorium.
+
+# Name Data Files
+- `vernacularNames.csv` <br>
+ Obtained from <https://opendata.eol.org/dataset/vernacular-names> on 24/04/2022 (last updated on 27/10/2020).
+ Contains alternative-node-names data from EOL.
+
+# Image Metadata Files
+- `imagesList.tgz` <br>
+ Obtained from <https://opendata.eol.org/dataset/images-list> on 24/04/2022 (last updated on 05/02/2020).
+ Contains metadata for images from EOL.
+- `imagesList/` <br>
+ Extracted from imagesList.tgz.
+- `gen_images_list_db.py` <br>
+ Creates a database, and imports imagesList/*.csv files into it.
+- `images_list.db` <br>
+ Created by running genImagesListDb.py <br>
+ Tables: <br>
+ - `images`:
+ `content_id INT PRIMARY KEY, page_id INT, source_url TEXT, copy_url TEXT, license TEXT, copyright_owner TEXT`
+
+# Image Generation Files
+- `download_imgs.py` <br>
+ Used to download image files into imgs_for_review/.
+- `review_imgs.py` <br>
+ Used to review images in imgs_for_review/, moving acceptable ones into imgs/.