From 5de5fb93e50fe9006221b30ac4a66f1be0db82e7 Mon Sep 17 00:00:00 2001 From: Terry Truong Date: Sun, 11 Sep 2022 14:55:42 +1000 Subject: Add backend unit tests - Add unit testing code in backend/tests/ - Change to snake-case for script/file/directory names - Use os.path.join() instead of '/' - Refactor script code into function defs and a main-guard - Make global vars all-caps Some fixes: - For getting descriptions, some wiki redirects weren't properly resolved - Linked images were sub-optimally propagated - Generation of reduced trees assumed a wiki-id association implied a description - Tilo.py had potential null dereferences by not always using a reduced node set - EOL image downloading didn't properly wait for all threads to end when finishing --- backend/tolData/dbpedia/README.md | 29 ----------------------------- 1 file changed, 29 deletions(-) delete mode 100644 backend/tolData/dbpedia/README.md (limited to 'backend/tolData/dbpedia/README.md') diff --git a/backend/tolData/dbpedia/README.md b/backend/tolData/dbpedia/README.md deleted file mode 100644 index dd9bda7..0000000 --- a/backend/tolData/dbpedia/README.md +++ /dev/null @@ -1,29 +0,0 @@ -This directory holds files obtained/derived from [Dbpedia](https://www.dbpedia.org). - -# Downloaded Files -- `labels_lang=en.ttl.bz2`
- Obtained via https://databus.dbpedia.org/dbpedia/collections/latest-core. - Downloaded from . -- `page_lang=en_ids.ttl.bz2`
- Downloaded from -- `redirects_lang=en_transitive.ttl.bz2`
- Downloaded from . -- `disambiguations_lang=en.ttl.bz2`
- Downloaded from . -- `instance-types_lang=en_specific.ttl.bz2`
- Downloaded from . -- `short-abstracts_lang=en.ttl.bz2`
- Downloaded from . - -# Other Files -- genDescData.py
- Used to generate a database representing data from the ttl files. -- descData.db
- Generated by genDescData.py.
- Tables:
- - `labels`: `iri TEXT PRIMARY KEY, label TEXT ` - - `ids`: `iri TEXT PRIMARY KEY, id INT` - - `redirects`: `iri TEXT PRIMARY KEY, target TEXT` - - `disambiguations`: `iri TEXT PRIMARY KEY` - - `types`: `iri TEXT, type TEXT` - - `abstracts`: `iri TEXT PRIMARY KEY, abstract TEXT` -- cgit v1.2.3