hluu / spark-iot

These are some code examples

Spark Saturday July 27.

Jumpstart on Apache Spark 2.2 with Databricks

Agenda

Morning

• Get to know Databricks
  • Notebook 0
• Overview of Spark Fundamentals & Architecture
• What’s New in Spark 2.x
• Break
• Unified APIs: SparkSessions, SQL, DataFrames, Datasets…
• Workshop Notebook 1 Lunch

Afternoon

• Introduction to DataFrames, Datasets and Spark SQL
• Workshop Notebook 2
• Break
• Introduction to Structured Streaming Concepts
• Workshop Notebook 3

Instructions to Register for Free Databricks Community Edition

1. Go to http://databricks.com/try-databricks

2. Start Today for Community Edition.

3. Make sure you use an email address from which you can access e-mails.

Notebooks URLS for the Labs:

• Word Count: http://dbricks.co/ss_wkshp0
• Spark Session: http://dbricks.co/ss_wkshp1
• SQL & Datasets (optional): http://dbricks.co/sqlds_wkshp2
• DataFrames & SQL (optional): http://dbricks.co/sqldf_wkshp2
• Mount Points (python): http://dbricks.co/data_mounts
• Datasets & IoT Devices: http://dbricks.co/iotds_wkshp3
• Streaming * IoT Devices: http://dbricks.co/iotss_wkshp4

Resources and APIs

• http://docs.databricks.com
• http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.SparkSession
• https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.Dataset