aboutsummaryrefslogtreecommitdiff
path: root/backend/tolData/enwiki/genPageviewData.py
AgeCommit message (Collapse)Author
2022-09-11Add backend unit testsTerry Truong
- Add unit testing code in backend/tests/ - Change to snake-case for script/file/directory names - Use os.path.join() instead of '/' - Refactor script code into function defs and a main-guard - Make global vars all-caps Some fixes: - For getting descriptions, some wiki redirects weren't properly resolved - Linked images were sub-optimally propagated - Generation of reduced trees assumed a wiki-id association implied a description - Tilo.py had potential null dereferences by not always using a reduced node set - EOL image downloading didn't properly wait for all threads to end when finishing
2022-09-07Add python type annotationsTerry Truong
Also use consistent quote symbols Also use 'is None' instead of '== None' Also use 'if list1' instead of 'if len(list1) > 0'
2022-08-30Add node-popularity data for search-sugg orderingTerry Truong
Add Wikipedia pageview dumps to enwiki/pageview/ Add scripts to generate viewcount averages Update backend to sort search suggestions by popularity