-
Oracle Java 8
-
spark_version: "2.0.0-bin-hadoop2.7"
-
Anaconda3-4.2.0-Linux-x86_64.sh (python3)
-
Jupyter Scala binaries for Scala 2.11 when using python3
You must have Ansible, VirtualBox, and Vagrant installed. See ANSIBLE.adoc. As provided, the Vagrant VM will use all of your cores and 1/2 of your memory.
$ go.sh
-
create a file called data/apikey.py and add the line apikey = "<your key>"
-
you can get a key from http://api.census.gov/data/key_signup.html more info at https://uscensusbureau.github.io/citysdk/
-
-
open http://localhost:8888 in the browser
-
change directory to /vagrant/data in Jupiter notebook
-
open census01.ipynb notebook
-
run Cell/Run All
-
in the Python Jupyter notebook you can access the spark context with variable sc
-
remember to do
vagrant destroy
when you are done