Student ID: 1747175 Supervisor: Luc Moreau
- Navigate to the root directory of this project
- Clone the OpenWPM repository:
git clone https://github.com/mozilla/OpenWPM
- Run install scripts
Run
install_pypackages.sh
Runconda activate prjprov
NOTE: Due to restrictions by OpenWPM, this software can only be run on Ubuntu and macOS (Homebrew required for macOS). - Navigate to the OpenWPM directory and run:
Ubuntu:
./install.sh
macOS:./install-mac-dev.sh
- Make sure the current conda environment is set to
prjprov
- Run
main_script.sh
with following parameters:
-s
followed by either a website URL or a filepath to a .txt file with the list of websites to visit separated by lines.-d
followed by either 1 or 0. This indicates the DNT header value.
Example: ./main_script.sh -s http://google.com -d 1
- OpenWPM will open a browser instance and visit the specified websites
main.py
is executed which records provenance and outputs an analysis- Recorded files are located in the
Crawls/Results/
directory
If installation of OpenWPM or a crawl fails, please run ./no_crawl.sh
that will record provenance and perform analysis on sample data included in the repository. Due to OpenWPM being an open source software that it frequently updated, it cannot be guaranteed that it will run with the current version of this project.