From 5de5fb93e50fe9006221b30ac4a66f1be0db82e7 Mon Sep 17 00:00:00 2001 From: Terry Truong Date: Sun, 11 Sep 2022 14:55:42 +1000 Subject: Add backend unit tests - Add unit testing code in backend/tests/ - Change to snake-case for script/file/directory names - Use os.path.join() instead of '/' - Refactor script code into function defs and a main-guard - Make global vars all-caps Some fixes: - For getting descriptions, some wiki redirects weren't properly resolved - Linked images were sub-optimally propagated - Generation of reduced trees assumed a wiki-id association implied a description - Tilo.py had potential null dereferences by not always using a reduced node set - EOL image downloading didn't properly wait for all threads to end when finishing --- backend/tolData/eol/README.md | 31 ------------------------------- 1 file changed, 31 deletions(-) delete mode 100644 backend/tolData/eol/README.md (limited to 'backend/tolData/eol/README.md') diff --git a/backend/tolData/eol/README.md b/backend/tolData/eol/README.md deleted file mode 100644 index c07b48e..0000000 --- a/backend/tolData/eol/README.md +++ /dev/null @@ -1,31 +0,0 @@ -This directory holds files obtained via the [Encyclopedia of Life](https://eol.org/). - -# Mapping Files -- `provider_ids.csv.gz`
- Obtained from on 22/08/22 (says last updated 27/07/22). - Associates EOL IDs with taxon IDs from sources like NCBI and Index Fungorium. - -# Name Data Files -- vernacularNames.csv
- Obtained from on 24/04/2022 (last updated on 27/10/2020). - Contains alternative-node-names data from EOL. - -# Image Metadata Files -- imagesList.tgz
- Obtained from on 24/04/2022 (last updated on 05/02/2020). - Contains metadata for images from EOL. -- imagesList/
- Extracted from imagesList.tgz. -- genImagesListDb.py
- Creates a database, and imports imagesList/*.csv files into it. -- imagesList.db
- Created by running genImagesListDb.py
- Tables:
- - `images`: - `content_id INT PRIMARY KEY, page_id INT, source_url TEXT, copy_url TEXT, license TEXT, copyright_owner TEXT` - -# Image Generation Files -- downloadImgs.py
- Used to download image files into imgsForReview/. -- reviewImgs.py
- Used to review images in imgsForReview/, moving acceptable ones into imgs/. -- cgit v1.2.3