From 882cd54fa955b4fada612574ef13bdab1608f1de Mon Sep 17 00:00:00 2001 From: Terry Truong Date: Sun, 1 May 2022 17:09:04 +1000 Subject: Add fuzzy-search via sqlite extension spellfix1 Also add delay between client search-suggestion requests when search input undergoes multiple quick changes --- backend/data/README.md | 23 ++++++++++++++++++++--- 1 file changed, 20 insertions(+), 3 deletions(-) (limited to 'backend/data/README.md') diff --git a/backend/data/README.md b/backend/data/README.md index 88053b5..b4ee77e 100644 --- a/backend/data/README.md +++ b/backend/data/README.md @@ -5,9 +5,26 @@ File Generation Process table using data in otol/*. 3 Run genEolNameData.py, which adds a 'names' table to data.db, using data in eol/vernacularNames.csv and the 'nodes' table. -4 Use downloadImgsForReview.py to download EOL images into imgsForReview/. +4 Run genSpellfixNameData.py, which adds a 'spellfix\_alt\_names' + table to data.db, using data in the 'names' table. +5 Use downloadImgsForReview.py to download EOL images into imgsForReview/. It uses data in eol/imagesList.db, and the 'nodes' table. -5 Use reviewImgs.py to filter images in imgsForReview/ into EOL-id-unique +6 Use reviewImgs.py to filter images in imgsForReview/ into EOL-id-unique images in imgsReviewed/ (uses 'names' to display common names). -6 Use genImgsForWeb.py to create cropped/resized images in img/, using +7 Use genImgsForWeb.py to create cropped/resized images in img/, using images in imgsReviewed, and also to add an 'images' table to data.db. + +spellfix.so +=========== +This file provides the spellfix1 extension for Sqlite, and +is used for responding to fuzzy-search requests. + +It was obtained by: +1 Downloading the sqlite source tree from + the github mirror at , + into a directory sqlite/ +2 After making sure autoconf 2.61+ and libtool are installed, + running `mkdir bld; cd bld; ../sqlite/configure;` +3 Running `make` +4 Running `cp ../sqlite/ext/misc/spellfix.c .` +5 Running `gcc -fPIC -shared spellfix.c -o spellfix.so` -- cgit v1.2.3