aboutsummaryrefslogtreecommitdiff
path: root/backend/data/README.md
diff options
context:
space:
mode:
authorTerry Truong <terry06890@gmail.com>2022-05-12 00:10:12 +1000
committerTerry Truong <terry06890@gmail.com>2022-05-12 00:10:12 +1000
commite1ef2bf3387769de4edc4a7ec1a6d38c5a21c5e7 (patch)
treed2a8ee2f6e36cbbc723de774965c9a001b746b0d /backend/data/README.md
parent4872ce9c22cc3c7024075f66409efdaf8860e9b8 (diff)
Add reduced-tree data generation+serving+querying+setting
Add genReducedTreeData.py, which generates a reduced_nodes table. Adjust server to serve that data for queries with a tree=reduced query param. Adjust client to query for that data depending on a useReducedTree variable. Add a SettingsPane setting to change that useReducedTree variable.
Diffstat (limited to 'backend/data/README.md')
-rw-r--r--backend/data/README.md7
1 files changed, 6 insertions, 1 deletions
diff --git a/backend/data/README.md b/backend/data/README.md
index 27619de..c4c46ba 100644
--- a/backend/data/README.md
+++ b/backend/data/README.md
@@ -7,7 +7,7 @@ File Generation Process
table using data in otol/*.
2 Name Data for Search
1 Obtain data in eol/, as specified in it's README.
- 2 Run genEolNameData.py, which adds 'names' and 'eol\_ids' tables to data.db,
+ 2 Run genEolNameData.py, which adds 'names' and 'eol\_ids' tables to data.db,
using data in eol/vernacularNames.csv and the 'nodes' table.
3 Image Data
1 Use downloadImgsForReview.py to download EOL images into imgsForReview/.
@@ -20,6 +20,9 @@ File Generation Process
1 Obtain data in enwiki/, as specified in it's README.
2 Run genEnwikiData.py, which adds a 'descs' table to data.db,
using data in enwiki/enwikiData.db, and the 'nodes' table.
+5 Reduced Tree Structure Data
+ 1 Run genReducedTreeData.py, which adds a 'reduced_nodes' table to data.db,
+ using reducedTol/names.txt, and the 'nodes' and 'names' tables.
data.db tables
==============
@@ -33,3 +36,5 @@ data.db tables
eol\_id INT PRIMARY KEY, source\_url TEXT, license TEXT, copyright\_owner TEXT
- descs <br>
name TEXT PRIMARY KEY, desc TEXT, redirected INT
+- reduced\_nodes <br>
+ name TEXT PRIMARY KEY, children TEXT, parent TEXT, tips INT, p_support INT