aboutsummaryrefslogtreecommitdiff
path: root/backend/data
AgeCommit message (Collapse)Author
2022-06-15Adjust 'node_imgs' table to use node name, not idTerry Truong
2022-06-15Move tree-trimming code into separate script/stageTerry Truong
2022-06-15Add 'src' field to 'names' tableTerry Truong
2022-06-14Fix bugs in web-img generationTerry Truong
Also adjust image-reviewing script to allow skiping some user-choices
2022-06-11Adapted linked-images code to handle merged image setsTerry Truong
2022-06-11Adjust server+client code to handle merged image setsTerry Truong
2022-06-11Adapt genImgsForWeb.py to process merged image setsTerry Truong
2022-06-11Add yet more manual-correction for node-desc generationTerry Truong
2022-06-10Add some manual-correction code in eol-name-generationTerry Truong
2022-06-10Add script for merging eol and enwiki image setsTerry Truong
2022-06-08Update READMEs, refactor getEnwikiImgData.pyTerry Truong
2022-06-08Adjust dbp-desc generation for yet more manual correctionsTerry Truong
2022-06-08Avoid some redundant enwiki-generated alt-namesTerry Truong
2022-06-08Fix small bugs in enwiki-desc generationTerry Truong
2022-06-07Add more manual-correction for dbp-desc generationTerry Truong
2022-06-07Add more heuristics for eol-otol-associationTerry Truong
2022-06-07Add more manual-correction for generated otol-dataTerry Truong
2022-06-05Add script for downloading enwiki info-box imagesTerry Truong
2022-06-05Move EOL image download/review scripts into eol/Terry Truong
2022-06-04Add tile-info otol linksTerry Truong
2022-06-03Add script for downloading img license infoTerry Truong
2022-06-03Add script for extracting enwiki infobox-image namesTerry Truong
2022-06-03Adjust enwiki dump-index-db and lookup script to include wiki-idsTerry Truong
2022-06-03Rename some scripts to be eol-specific indicativeTerry Truong
2022-06-01Add script/instructions for filtering out mismatching node descsTerry Truong
2022-05-28Convert from python "...".format() to f"..."Terry Truong
2022-05-28Fix tree-trimming to not discard certain nodesTerry Truong
Was trimming off nodes without an image/desc/reduced_tree_presence, including those with a descdendant that has them. Was using a linked-image association to prevent this, but this wasn't reliable.
2022-05-26Fix missed space-to-underscore conversion in lookupPage.pyTerry Truong
2022-05-26Add some enwiki redirect data as alt-namesTerry Truong
2022-05-26Trim otol tree to avoid certain slowdownsTerry Truong
Some nodes had multiple ancestors with over 10k children, and jump-searching to them could take almost a minute for vue to load.
2022-05-24For compound-nodes without sub-images, don't use a child imageTerry Truong
2022-05-24Don't generate compound-image if both sub-images non-existentTerry Truong
2022-05-23Display 'compound images'Terry Truong
Adjust genLinkedImgs.py to associate multiple images to compound-nodes. Adjust server to send multiple image filenames for such nodes. Adjust Tile and TileInfoModal to display those compound-images.
2022-05-22Up-propgate images for usage in parents without imagesTerry Truong
Also adjust vite config to avoid apparent redundant processing when images are being downloaded.
2022-05-19Unescape EOL alt-name dataTerry Truong
2022-05-19Fix not scrolling to focused nodesTerry Truong
2022-05-18Add wikipedia-link to tile-info displayTerry Truong
Add 'wiki_id' and 'from_dbp' columns to 'descs' table, adjust dbpedia data to include wikipedia IDs, adjust data generations scripts, make server send extra data, and make TileInfo display it.
2022-05-18For dbpedia data, prioritise manual conflict resolutionsTerry Truong
2022-05-17Make reduced tree generation check non-alt-namesTerry Truong
2022-05-17Remove certain same-name alt-namesTerry Truong
2022-05-17Make search suggestions include non-alt-namesTerry Truong
2022-05-17Fix small genDbpData.py typoTerry Truong
2022-05-17Improve enwiki description extractionTerry Truong
Adjust enwiki code to handle single dump file, and add scripts for 'convenient' page-content lookup.
2022-05-15Converted nodes+r_nodes tables into nodes+edges+r_nodes+r_edgesTerry Truong
Conversion avoids encoding node children as JSON strings, and allows for easier querying of edge data. Adjusted server to use new format. Also added some table indexes for common operations.
2022-05-14Add desc-resolution special-case for root nodeTerry Truong
2022-05-14Supplement DBpedia descs with enwiki'sTerry Truong
2022-05-14Use DBpedia data for node descriptionsTerry Truong
Add backend/data/dbpedia/ directory containing scripts and README for obtaining DBpedia data, storing it into a db, converting/adding description data to data.db, and for resolving tol-node DBpedia-node association conflicts (via DBpedia relations, manual listing, etc). Resulted in less (about 3/4 as many) descriptions as with using enwiki, but with notably less mis-associations (eg: node Thor is described as a shrimp instead of a god).
2022-05-12Adjust reviewImgs.py to remove EXIF orientation dataTerry Truong
2022-05-12Commit reduced-tree name-list dataTerry Truong
2022-05-12Add reduced-tree data generation+serving+querying+settingTerry Truong
Add genReducedTreeData.py, which generates a reduced_nodes table. Adjust server to serve that data for queries with a tree=reduced query param. Adjust client to query for that data depending on a useReducedTree variable. Add a SettingsPane setting to change that useReducedTree variable.