aboutsummaryrefslogtreecommitdiff
path: root/.gitignore
AgeCommit message (Collapse)Author
2022-08-30Add node-popularity data for search-sugg orderingTerry Truong
Add Wikipedia pageview dumps to enwiki/pageview/ Add scripts to generate viewcount averages Update backend to sort search suggestions by popularity
2022-08-30Add scripts for generating eol/enwiki mappingsTerry Truong
- New data sources: OTOL taxonomy, EOL provider-ids, Wikidata dump - Add 'node_iucn' table - Remove 'redirected' field from 'wiki_ids' table - Make 'eol_ids' table have 'name' as the primary key - Combine name-generation scripts into genNameData.py - Combine description-generation scripts into genDescData.py
2022-07-11Add deployment documentationTerry Truong
2022-07-11Make backend dev server script serve the image filesTerry Truong
Previously, image files in backend/data/img were moved to, or symlinked from, public/. This needed to be changed before each build, otherwise vite would end up copying gigabytes of images.
2022-07-09Replace CGI script with WSGI script and dev serverTerry Truong
2022-07-01Generate 3 reduced trees, keeping the original, and serve only thoseTerry Truong
Generate a 'trimmed' reduced tree instead of changing the original. Generate an 'images-only' reduced tree, and use it as the default. Combine 'picked' reduced tree code with that of other reduced trees. Adapt server API to allow selecting between more than 2 trees. Add client setting for selecting between 3 trees.
2022-06-23Update some client-side READMEsTerry Truong
2022-06-22Update backend READMEs, rename some files for consistencyTerry Truong
2022-06-19Add code/file for adding manually-picked alt-namesTerry Truong
2022-06-19Make manual enwiki-desc-associations more flexibleTerry Truong
Also enable getEnwikiImgData.py to skip already-processed wiki-ids
2022-06-19Allow for manually adding images from other sourcesTerry Truong
2022-06-17Add code+file for excluding bad-alt-namesTerry Truong
2022-06-17Stop tracking reduced-tree name-setTerry Truong
2022-06-11Add yet more manual-correction for node-desc generationTerry Truong
2022-06-10Add some manual-correction code in eol-name-generationTerry Truong
2022-06-10Add script for merging eol and enwiki image setsTerry Truong
2022-06-07Add more manual-correction for dbp-desc generationTerry Truong
2022-06-07Add more manual-correction for generated otol-dataTerry Truong
2022-06-05Add script for downloading enwiki info-box imagesTerry Truong
2022-06-05Move EOL image download/review scripts into eol/Terry Truong
2022-06-01Add script/instructions for filtering out mismatching node descsTerry Truong
2022-05-26Trim otol tree to avoid certain slowdownsTerry Truong
Some nodes had multiple ancestors with over 10k children, and jump-searching to them could take almost a minute for vue to load.
2022-05-17Improve enwiki description extractionTerry Truong
Adjust enwiki code to handle single dump file, and add scripts for 'convenient' page-content lookup.
2022-05-14Use DBpedia data for node descriptionsTerry Truong
Add backend/data/dbpedia/ directory containing scripts and README for obtaining DBpedia data, storing it into a db, converting/adding description data to data.db, and for resolving tol-node DBpedia-node association conflicts (via DBpedia relations, manual listing, etc). Resulted in less (about 3/4 as many) descriptions as with using enwiki, but with notably less mis-associations (eg: node Thor is described as a shrimp instead of a god).
2022-05-04Add scripts for obtaining/sending/displaying wikipedia descriptionsTerry Truong
Add backend/data/enwiki/ directory containing scripts and instructive READMEs. Adjust some other scripts to generate 'eol_ids' sqlite table separate from 'names'. Make server respond to /data/desc requests, and have client TileInfo component display response data. Also adjust .gitignore entries to be root-relative.
2022-04-30Make TileInfoModal display more dataTerry Truong
2022-04-26Have tol data in sqlite db, and add server script that accesses itTerry Truong
Adapt otol-data-converting script to generate otol.db, add server.py script that provides access to that db, and adapt the app to query the server for tol data when needed.
2022-04-25Adapt to handle open-tree-of-life dataTerry Truong
Added data_otol/ with script that converts data from 'Open Tree of Life' release 13.4 into a JSON form. Moved old tree-of-life data and images into data_tol_old/. Added TolMap type to tol.ts, changed TolNode, and adapted other code to handle it. Temporarily disabling tile images until image data is added.
2022-03-28Split lib.ts into layout.ts and util.tsTerry Truong
2022-03-18Add more data. Stop tracking generated data.Terry Truong
2022-03-02Initial commitTerry Truong