junnzhan / machine-learning-with-spark-second-edition Goto Github PK

View Code? Open in Web Editor NEW

Machine Learning with Spark - Second Edition, by Packt

License: MIT License

Java 0.33% Python 8.38% R 0.23% Scala 66.54% Jupyter Notebook 24.53%

machine-learning-with-spark-second-edition's Introduction

Machine Learning with Spark - Second Edition

This is the code repository for Machine Learning with Spark - Second Edition, published by Packt. It contains all the supporting project files necessary to work through the book from start to finish.

About the Book

This book will teach you about popular machine learning algorithms and their implementation. You will learn how various machine learning concepts are implemented in the context of Spark ML. You will start by installing Spark in a single and multinode cluster. Next you'll see how to execute Scala and Python based programs for Spark ML. Then we will take a few datasets and go deeper into clustering, classification, and regression. Toward the end, we will also cover text processing using Spark ML.

Instructions and Navigation

All of the code is organized into folders. Each folder starts with a number followed by the application name. For example, Chapter02.

Chapter 03 does not contain code files.

The code will look like the following:

val conf = new SparkConf()
.setAppName("Test Spark App")
.setMaster("local[4]")
val sc = new SparkContext(conf)

Throughout this book, we assume that you have some basic experience with programming in Scala or Python and have some basic knowledge of machine learning, statistics, and data analysis.

junnzhan / machine-learning-with-spark-second-edition Goto Github PK