From d70b96295d768aa0c80bf66639ad7a56bdef92a8 Mon Sep 17 00:00:00 2001 From: Terry Truong Date: Sun, 2 Oct 2022 12:23:19 +1100 Subject: Add gen_pop_data.py --- backend/hist_data/enwiki/README.md | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) (limited to 'backend/hist_data/enwiki/README.md') diff --git a/backend/hist_data/enwiki/README.md b/backend/hist_data/enwiki/README.md index dd090ca..95795f3 100644 --- a/backend/hist_data/enwiki/README.md +++ b/backend/hist_data/enwiki/README.md @@ -19,16 +19,6 @@ This directory holds files obtained/derived from [English Wikipedia](https://en. Tables:
- `offsets`: `id INT PRIMARY KEY, title TEXT UNIQUE, offset INT, next_offset INT` -# Description Files -- `gen_desc_data.py`
- Reads through pages in the dump file, and adds short-description info to a database. -- `desc_data.db`
- Generated by `gen_desc_data.py`.
- Tables:
- - `pages`: `id INT PRIMARY KEY, title TEXT UNIQUE` - - `redirects`: `id INT PRIMARY KEY, target TEXT` - - `descs`: `id INT PRIMARY KEY, desc TEXT` - # Page View Files - `pageviews/pageviews-*-user.bz2` Each holds wikimedia article page view data for some month. @@ -58,3 +48,13 @@ This directory holds files obtained/derived from [English Wikipedia](https://en. Might lack some matches for `img_name` in `page_imgs`, due to licensing info unavailability. - `download_imgs.py`
Used to download image files into imgs/. + +# Description Files +- `gen_desc_data.py`
+ Reads through pages in the dump file, and adds short-description info to a database. +- `desc_data.db`
+ Generated by `gen_desc_data.py`.
+ Tables:
+ - `pages`: `id INT PRIMARY KEY, title TEXT UNIQUE` + - `redirects`: `id INT PRIMARY KEY, target TEXT` + - `descs`: `id INT PRIMARY KEY, desc TEXT` -- cgit v1.2.3