From e1ef2bf3387769de4edc4a7ec1a6d38c5a21c5e7 Mon Sep 17 00:00:00 2001 From: Terry Truong Date: Thu, 12 May 2022 00:10:12 +1000 Subject: Add reduced-tree data generation+serving+querying+setting Add genReducedTreeData.py, which generates a reduced_nodes table. Adjust server to serve that data for queries with a tree=reduced query param. Adjust client to query for that data depending on a useReducedTree variable. Add a SettingsPane setting to change that useReducedTree variable. --- backend/data/README.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) (limited to 'backend/data/README.md') diff --git a/backend/data/README.md b/backend/data/README.md index 27619de..c4c46ba 100644 --- a/backend/data/README.md +++ b/backend/data/README.md @@ -7,7 +7,7 @@ File Generation Process table using data in otol/*. 2 Name Data for Search 1 Obtain data in eol/, as specified in it's README. - 2 Run genEolNameData.py, which adds 'names' and 'eol\_ids' tables to data.db, + 2 Run genEolNameData.py, which adds 'names' and 'eol\_ids' tables to data.db, using data in eol/vernacularNames.csv and the 'nodes' table. 3 Image Data 1 Use downloadImgsForReview.py to download EOL images into imgsForReview/. @@ -20,6 +20,9 @@ File Generation Process 1 Obtain data in enwiki/, as specified in it's README. 2 Run genEnwikiData.py, which adds a 'descs' table to data.db, using data in enwiki/enwikiData.db, and the 'nodes' table. +5 Reduced Tree Structure Data + 1 Run genReducedTreeData.py, which adds a 'reduced_nodes' table to data.db, + using reducedTol/names.txt, and the 'nodes' and 'names' tables. data.db tables ============== @@ -33,3 +36,5 @@ data.db tables eol\_id INT PRIMARY KEY, source\_url TEXT, license TEXT, copyright\_owner TEXT - descs
name TEXT PRIMARY KEY, desc TEXT, redirected INT +- reduced\_nodes
+ name TEXT PRIMARY KEY, children TEXT, parent TEXT, tips INT, p_support INT -- cgit v1.2.3