- Create crawl environment with the following command:
conda env create -f environment.yml
- To set up environment, type the following: source activate crawl
- sudo apt-get update
- sudo apt-get install spyder
- Type
spyder3
in crawl environment to bring up spyder IDE
- Create MySQL database with the UTF8mb4 encoding, e.g.:
CREATE DATABASE mydb CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci
- Run .sql files to create the respective MySQL tables.
- Linux version of Chromedriver for Chrome version 78.0.3904.108 used (included).
Pending further updates.