faadal / spark-sbt.g8

A giter8 template for Spark SBT projects

spark-sbt.g8

A Giter8 template for Spark SBT applications.

Usage

1. Install Giter8 with Homebrew: brew update && brew install giter8

2. Start the app generation wizard: g8 MrPowers/spark-sbt.g8

3. Fill out the project properties on the command line

4. Run the tests to make sure the project was generated correctly. cd into the top level project directory and then run sbt test.

5. (optional) run the shell scripts to add the log4j.properties file and additional options to the build.sbt file

Project Properties

name (default: my-cool-project)

The project name. This should be all lowercase and use hyphens.

package (default: com.github.mrpowers.my.cool.project)

The top-level package of the project. This is typically the organization name followed by the project name.

For example, the top level package of spark-daria is com.github.mrpowers.spark.daria.sql, which consists of the organization name com.github.mrpowers and the project name spark.daria.sql.

scalaVersion (default: 2.11.12)

sparkVersion (default: 2.3.0)

sbtVersion (default: 0.13.17)

version (default: 0.0.1)

The project version. 0.0.1 is usually the best place to start.

Contribution

Send pull requests to keep this project updated.

We'll always try to keep this updated with the latest version of Spark and Scala.