pyspark-notebook
Use jupyter/pyspark-noteook
in a spark-native manner.
Jupyter pyspark-notebook
Changes from-
Use
pyspark
to start jupyter notebook- Using
SPARK_SUBMIT_OPTS
, instead ofSPARK_OPTS
- Pre-configured configs: See
spark/conf/spark-defaults.conf
- Using
-
Pre-installed koalas package
-
Change the kernel spec
- display name is now
pyspark 3.0.0
- display name is now
-
IPyKernel Configuration
- Add links to help menu