chrishawkins / cluster-in-a-box Goto Github PK

spark-1 | Starting Slave ID: 36042; IP Address: 172.18.0.5 ; Master: spark-master:7077
spark-1 | starting datanode, logging to /usr/local/hadoop/logs/hadoop--datanode-spark-1.out
spark-1 | chown: missing operand after '/usr/local/hadoop/logs'
spark-1 | Try 'chown --help' for more information.
spark-1 | starting nodemanager, logging to /usr/local/hadoop/logs/yarn--nodemanager-spark-1.out
spark-1 | rsync from spark-master:7077
spark-1 | starting org.apache.spark.deploy.worker.Worker, logging to /usr/local/spark/sbin/../logs/spark--org.apache.spark.deploy.worker.Worker-1-spark-1.out
spark-1 | ssh: connect to host spark-master port 22: Connection refused
spark-1 | rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]
spark-1 | rsync error: unexplained error (code 255) at io.c(226) [Receiver=3.1.0]
spark-1 | Spark Command: /usr/lib/jvm/java-8-oracle//bin/java -cp /usr/local/spark/sbin/../conf/:/usr/local/spark/lib/spark-assembly-1.4.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar:/usr/local/hadoop/etc/hadoop/:/etc/hadoop -Xms512m -Xmx512m org.apache.spark.deploy.worker.Worker --webui-port 8081 36042 spark-master:7077 -h 172.18.0.5
spark-1 | ========================================
spark-1 | 16/01/25 16:27:40 INFO worker.Worker: Registered signal handlers for [TERM, HUP, INT]
spark-1 | Usage: Worker [options] <master>
spark-1 | 
spark-1 | Master must be a URL of the form spark://hostname:port
spark-1 | 
spark-1 | Options:
spark-1 |   -c CORES, --cores CORES  Number of cores to use
spark-1 |   -m MEM, --memory MEM     Amount of memory to use (e.g. 1000M, 2G)
spark-1 |   -d DIR, --work-dir DIR   Directory to run apps in (default: SPARK_HOME/work)
spark-1 |   -i HOST, --ip IP         Hostname to listen on (deprecated, please use --host or -h)
spark-1 |   -h HOST, --host HOST     Hostname to listen on
spark-1 |   -p PORT, --port PORT     Port to listen on (default: random)
spark-1 |   --webui-port PORT        Port for web UI (default: 8081)
spark-1 |   --properties-file FILE   Path to a custom Spark properties file.
spark-1 |                            Default is conf/spark-defaults.conf.
spark-1 | 16/01/25 16:27:41 INFO util.Utils: Shutdown hook called