josh-joseph / starcluster-tools

starcluster-tools

The scope of this code is a set of tools to make life easier using starcluster for EC2.

Running StarCluster the first time:

1. Install dependencies (last time I tried this, the versions on pip were too old)

      https://pypi.python.org/pypi/pyasn1
      https://pypi.python.org/pypi/decorator
      pip install git+git://github.com/boto/boto.git
   

2. Pull the development version from git and install it using pip

      pip install git+git://github.com/jtriley/StarCluster.git
   

3. Run

      starcluster help
   

4. Select "[2] Write config template to /home/user/.starcluster/config"

5. Replace your .starcluster/config file with the config file from this git repo

6. Enter your AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, and CLUSTER_USER

7. See Starcluster's quick start guide for help creating a SSH key, editing the config file to use your newly created key, and launching your first cluster

Other useful resources:

• Creating a new AMI

• StarCluster's Offical AMIs

• Using IPython Notebook for parallel learning with scikit-learn (see this specifically)

License:

This module is distrubted under the MIT license.