A one-step utility to setup a multi-nodes BigData cluster on OSX.
PocketCluster will soon be available after fixing few bugs. Please contact @stkim1 or join the slack channel for further detail.
Package | Version | Release Note |
---|---|---|
Apache Spark | 1.5.2 | RN 1.5.2 |
Apache Hadoop | 2.4.0 | RN 2.4.1 |
This installer has only been tested on El Capitan. May work fine on Yosemite 10.10.
In order for Spark/Hadoop to work, you need to open SSH server just for yourself.
- Open "System Preference"
- Open "Sharing"
- Check "Remote Login" for "Administators" only.
- Install following two additional requirements.
- Mac with at least 8GB Memory and 10 GB of free disk space is strongly recommended.
- All Raspberry PI 2 and a Mac should be behind the same router.
- Ethernet Connection required.
- Must use the image provided below.
- YOU DO NOT NEED TO CONFIGURE A SINGLE THING FOR ALL RASPBERRY PIs!!!
2015-11-13-ubuntu-trusty.img.zip (232 MB)- Checksum: 687a2e9b6c04f7a35449cc95405946e2
- [ApplePi-Baker 1.81] (http://www.tweaking4all.com/?wpfb_dl=94)
- Download uninstall script by right click and
Save link as...
. - Open console or iTerm, go to where the file is, and run following command.
chmod +x ./rpi-uninstall && ./rpi-uninstall
You can follow how and what progresses are made at https://pocketcluster.wordpress.com.
If you have a question, tweet me @stkim1.
PocketCluster is Copyright (C) 2015 Sung-Taek, Kim, All Rights Reserved.