Insufficient memory issue about eventsim

[bengecko]

Hey Sidi,

This probably means the JRE is configured to run with 8g memory but there
is not enough memory on the machine. How much RAM is on the machine you are
running? Also how is the JVM configured?

On Thursday, June 16, 2016, Sidi Chang [email protected] wrote:

I try to throw my data directly into Kafka but it seems like there are
some bugs with that.

Now: 2015-07-12T14:02:31.332, Events:60000, Rate: 4401 epsJava HotSpot(TM)
64-Bit Server VM warning: INFO: os::commit_memory(0x00000006c9000000,
830472192, 0) failed; error='Cannot allocate memory' (errno=12)

There is insufficient memory for the Java Runtime Environment to continue. Native
memory allocation (mmap) failed to map 830472192 bytes for committing
reserved memory. An error report file with more information is saved as:
/home/ubuntu/eventsim/hs_err_pid3267.log

ubuntu@ip-172-31-1-10:~/eventsim$ rm hs_err_pid3267.log

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#4, or mute the thread
https://github.com/notifications/unsubscribe/AIjLrpimyU78fTT1rLptJbChKP3W-QIpks5qMgGYgaJpZM4I3-M2
.

[LouisChang]

Hi Bengecko,

I am using Amazon AWS m4.large which should give me 8G or 16GB memory. I have one master and three workers. All the four machines are Kafka broker, the master node is the Spark Streaming seed node and Cassandra node. I run the data generator and put the throughput into the second worker, but it will give me this bug. Do you have any idea on this?

[bengecko]

If you AWS instance is configured with 8g then you will want to up it to
16g if possible.

Run:

free -m

To see how much memory you have. Also run:

ps -ef | grep java

Then copy and paste output into this thread.

On Friday, June 17, 2016, Sidi Chang [email protected] wrote:

Hi Bengecko,

I am using Amazon AWS m4.large which should give me 8G or 16GB memory. I
have one master and three workers. All the four machines are Kafka broker,
the master node is the Spark Streaming seed node and Cassandra node. I run
the data generator and put the throughput into the second worker, but it
will give me this bug. Do you have any idea on this?

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AIjLrvYlnGufASvF83eQL7TB7oFtrDw9ks5qMrHTgaJpZM4I3-M2
.

[LouisChang]

Hi,
After run free -m the output is
total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=9999 -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.Kafka /usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java -Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp /usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java -Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB -XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark -XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler -javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar -Dcassandra.jmx.local.port=7199 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password -Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin -Dlogback.configurationFile=logback.xml -Dcassandra.logdir=/usr/local/cassandra/bin/../logs -Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp /usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5 --port 7077 --webui-port 8080

[bengecko]

OK so it definitely looks like there is not enough memory on the machine to run the java process in question. There is always a certain amount of memory used for the operating system so if the java process is asking for more memory than is available, you’ll see the error you mentioned. My conclusion is you need more RAM on the AWS instance. 16G should be fine. Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang [email protected] wrote:

Hi,
After run free -m the output is

     total       used       free     shared    buffers     cached

Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=9999 -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.Kafka /usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java -Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp /usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java -Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea -XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42 -XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003 -XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB -XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000 -XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways -XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark -XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler -javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar -Dcassandra.jmx.local.port=7199 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password -Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin -Dlogback.configurationFile=logback.xml -Dcassandra.logdir=/usr/local/cassandra/bin/../logs -Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp /usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm -Dstorm.log.dir=/usr/local/storm/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35 -XX:+DisableExplicitGC -Djava.awt.headless=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dkafka.logs.dir=/usr/local/kafka/bin/../logs -Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties -cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar -Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5 --port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub #4 (comment), or mute the thread https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2.

[LouisChang]

Hi,

Thank you!

I re-ordered the AWS node and spent some time to trouble shooting with my
IP.

Finally everything is finished and works fine. I really thank you for your
help!

Best,

Sidi
On Friday, June 17, 2016, Ben Copeland <[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');> wrote:

OK so it definitely looks like there is not enough memory on the machine
to run the java process in question. There is always a certain amount of
memory used for the operating system so if the java process is asking for
more memory than is available, you’ll see the error you mentioned. My
conclusion is you need more RAM on the AWS instance. 16G should be fine.
Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang [email protected] wrote:

Hi,
After run free -m the output is

total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp
/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/usr/local/zookeeper/bin/../conf/zoo.cfg
root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=9999
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs
-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.Kafka
/usr/local/kafka/config/server.properties
ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java
-Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp
/usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf
ubuntu 5099 1 0 Jun15 ? 00:10:24 java
-Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea
-XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42
-XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003
-XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB
-XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000
-XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways
-XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M
-Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark
-XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler
-javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar
-Dcassandra.jmx.local.port=7199
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password
-Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin
-Dlogback.configurationFile=logback.xml
-Dcassandra.logdir=/usr/local/cassandra/bin/../logs
-Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp
/usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/
ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server
-Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf
-Xmx1024m -Dlogfile.name=nimbus.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.daemon.nimbus
ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server
-Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp
/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log
-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core
ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs
-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer --zookeeper
localhost:2181 --from-beginning --topic yyyyyy
ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp
/usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar
-Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5
--port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <
https://github.com/Interana/eventsim/issues/4#issuecomment-226797393>, or
mute the thread <
https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AEExOsKQyMjkCuvI5xmIZMnOXW_WBZevks5qMsFLgaJpZM4I3-M2
.

Sidi CHANG
Master in Computer Science (Computational Operations Research Track)
College of William and Mary
Williamsburg, VA, United States

[bengecko]

Sidi,

My pleasure I'm glad we got through it :)

On Friday, June 17, 2016, Sidi Chang [email protected] wrote:

Hi,

Thank you!

I re-ordered the AWS node and spent some time to trouble shooting with my
IP.

Finally everything is finished and works fine. I really thank you for your
help!

Best,

Sidi
On Friday, June 17, 2016, Ben Copeland <[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');
<javascript:_e(%7B%7D,'cvml','[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');');>> wrote:

OK so it definitely looks like there is not enough memory on the machine
to run the java process in question. There is always a certain amount of
memory used for the operating system so if the java process is asking for
more memory than is available, you’ll see the error you mentioned. My
conclusion is you need more RAM on the AWS instance. 16G should be fine.
Basically the java process needs room to allocate more memory as needed.

On Jun 17, 2016, at 08:16, Sidi Chang <[email protected]
javascript:_e(%7B%7D,'cvml','[email protected]');> wrote:

Hi,
After run free -m the output is

total used free shared buffers cached
Mem: 7983 7096 887 0 185 1272
-/+ buffers/cache: 5638 2345
Swap: 0 0 0

After running the second command, the output is
ubuntu 2771 1 0 Jun08 ? 00:11:42 /usr/bin/java -Dzookeeper.log.dir=.
-Dzookeeper.root.logger=INFO,CONSOLE -cp

/usr/local/zookeeper/bin/../build/classes:/usr/local/zookeeper/bin/../build/lib/.jar:/usr/local/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/usr/local/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/usr/local/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/usr/local/zookeeper/bin/../lib/log4j-1.2.16.jar:/usr/local/zookeeper/bin/../lib/jline-0.9.94.jar:/usr/local/zookeeper/bin/../zookeeper-3.4.6.jar:/usr/local/zookeeper/bin/../src/java/lib/.jar:/usr/local/zookeeper/bin/../conf:
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.local.only=false
org.apache.zookeeper.server.quorum.QuorumPeerMain
/usr/local/zookeeper/bin/../conf/zoo.cfg

root 3897 3896 0 Jun08 ? 01:51:14 java -Xmx1G -Xms1G -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Xloggc:/usr/local/kafka/bin/../logs/kafkaServer-gc.log -verbose:gc
-XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.port=9999
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs

-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.Kafka
/usr/local/kafka/config/server.properties

ubuntu 4426 1 0 Jun08 ? 01:05:43 /usr/bin/java
-Duser.dir=/usr/local/kafka-manager -Dhttp.port=9001 -cp

/usr/local/kafka-manager/lib/../conf/:/usr/local/kafka-manager/lib/kafka-manager.kafka-manager-1.3.0.8-sans-externalized.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-library-2.11.7.jar:/usr/local/kafka-manager/lib/com.typesafe.play.twirl-api_2.11-1.1.1.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-lang3-3.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.build-link-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-exceptions-2.4.4.jar:/usr/local/kafka-manager/lib/org.javassist.javassist-3.19.0-GA.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-iteratees_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/org.scala-stm.scala-stm_2.11-0.7.jar:/usr/local/kafka-manager/lib/com.typesafe.config-1.3.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-json_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-functional_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-datacommons_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/joda-time.joda-time-2.8.1.jar:/usr/local/kafka-manager/lib/org.joda.joda-convert-1.7.jar:/usr/local/kafka-manager/lib/org.scala-lang.scala-reflect-2.11.6.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-core-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-annotations-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.core.jackson-databind-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.5.4.jar:/usr/local/kafka-manager/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.5.4.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-utils-2.4.4.jar:/usr/local/kafka-manager/lib/org.slf4j.slf4j-api-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jul-to-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/org.slf4j.jcl-over-slf4j-1.7.12.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-core-1.1.3.jar:/usr/local/kafka-manager/lib/ch.qos.logback.logback-classic-1.1.3.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-actor_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/com.typesafe.akka.akka-slf4j_2.11-2.3.14.jar:/usr/local/kafka-manager/lib/commons-codec.commons-codec-1.10.jar:/usr/local/kafka-manager/lib/xerces.xercesImpl-2.11.0.jar:/usr/local/kafka-manager/lib/xml-apis.xml-apis-1.4.01.jar:/usr/local/kafka-manager/lib/javax.transaction.jta-1.1.jar:/usr/local/kafka-manager/lib/com.google.inject.guice-4.0.jar:/usr/local/kafka-manager/lib/javax.inject.javax.inject-1.jar:/usr/local/kafka-manager/lib/aopalliance.aopalliance-1.0.jar:/usr/local/kafka-manager/lib/com.google.guava.guava-16.0.1.jar:/usr/local/kafka-manager/lib/com.google.inject.extensions.guice-assistedinject-4.0.jar:/usr/local/kafka-manager/lib/com.typesafe.play.play-netty-server_2.11-2.4.4.jar:/usr/local/kafka-manager/lib/io.netty.netty-3.10.4.Final.jar:/usr/local/kafka-manager/lib/com.typesafe.netty.netty-http-pipelining-1.1.4.jar:/usr/local/kafka-manager/lib/com.google.code.findbugs.jsr305-2.0.1.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-play_2.11-2.4.0-2.jar:/usr/local/kafka-manager/lib/org.webjars.requirejs-2.1.20.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-0.28.jar:/usr/local/kafka-manager/lib/org.webjars.webjars-locator-core-0.27.jar:/usr/local/kafka-manager/lib/org.apache.commons.commons-compress-1.9.jar:/usr/local/kafka-manager/lib/org.webjars.npm.validate.js-0.8.0.jar:/usr/local/kafka-manager/lib/org.webjars.bootstrap-3.3.5.jar:/usr/local/kafka-manager/lib/org.webjars.jquery-2.1.4.jar:/usr/local/kafka-manager/lib/org.webjars.backbonejs-1.2.3.jar:/usr/local/kafka-manager/lib/org.webjars.underscorejs-1.8.3.jar:/usr/local/kafka-manager/lib/org.webjars.dustjs-linkedin-2.6.1-1.jar:/usr/local/kafka-manager/lib/org.webjars.json-20121008-1.jar:/usr/local/kafka-manager/lib/org.apache.curator.curator-framework-2.9.1.jar:/usr/local/kaf

ubuntu 5099 1 0 Jun15 ? 00:10:24 java
-Xloggc:/usr/local/cassandra/bin/../logs/gc.log -ea
-XX:+UseThreadPriorities -XX:ThreadPriorityPolicy=42
-XX:+HeapDumpOnOutOfMemoryError -Xss256k -XX:StringTableSize=1000003
-XX:+AlwaysPreTouch -XX:-UseBiasedLocking -XX:+UseTLAB -XX:+ResizeTLAB
-XX:+PerfDisableSharedMem -Djava.net.preferIPv4Stack=true
-XX:+UseParNewGC
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:SurvivorRatio=8
-XX:MaxTenuringThreshold=1 -XX:CMSInitiatingOccupancyFraction=75
-XX:+UseCMSInitiatingOccupancyOnly -XX:CMSWaitDuration=10000
-XX:+CMSParallelInitialMarkEnabled -XX:+CMSEdenChunksRecordAlways
-XX:+CMSClassUnloadingEnabled -XX:+PrintGCDetails -XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC -XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime -XX:+PrintPromotionFailure
-XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M
-Xms1995M -Xmx1995M -Xmn200M -XX:+UseCondCardMark
-XX:CompileCommandFile=/usr/local/cassandra/bin/../conf/hotspot_compiler
-javaagent:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar
-Dcassandra.jmx.local.port=7199
-Dcom.sun.management.jmxremote.authenticate=false

-Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password
-Djava.library.path=/usr/local/cassandra/bin/../lib/sigar-bin
-Dlogback.configurationFile=logback.xml
-Dcassandra.logdir=/usr/local/cassandra/bin/../logs
-Dcassandra.storagedir=/usr/local/cassandra/bin/../data -cp

/usr/local/cassandra/bin/../conf:/usr/local/cassandra/bin/../build/classes/main:/usr/local/cassandra/bin/../build/classes/thrift:/usr/local/cassandra/bin/../lib/ST4-4.0.8.jar:/usr/local/cassandra/bin/../lib/airline-0.6.jar:/usr/local/cassandra/bin/../lib/antlr-runtime-3.5.2.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-clientutil-3.6.jar:/usr/local/cassandra/bin/../lib/apache-cassandra-thrift-3.6.jar:/usr/local/cassandra/bin/../lib/asm-5.0.4.jar:/usr/local/cassandra/bin/../lib/caffeine-2.2.6.jar:/usr/local/cassandra/bin/../lib/cassandra-driver-core-3.0.0-shaded.jar:/usr/local/cassandra/bin/../lib/commons-cli-1.1.jar:/usr/local/cassandra/bin/../lib/commons-codec-1.2.jar:/usr/local/cassandra/bin/../lib/commons-lang3-3.1.jar:/usr/local/cassandra/bin/../lib/commons-math3-3.2.jar:/usr/local/cassandra/bin/../lib/compress-lzf-0.8.4.jar:/usr/local/cassandra/bin/../lib/concurrent-trees-2.4.0.jar:/usr/local/cassandra/bin/../lib/concurrentlinkedhashmap-lru-1.4.jar:/usr/local/cassandra/bin/../lib/disruptor-3.0.1.jar:/usr/local/cassandra/bin/../lib/ecj-4.4.2.jar:/usr/local/cassandra/bin/../lib/guava-18.0.jar:/usr/local/cassandra/bin/../lib/high-scale-lib-1.0.6.jar:/usr/local/cassandra/bin/../lib/hppc-0.5.4.jar:/usr/local/cassandra/bin/../lib/jackson-core-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jackson-mapper-asl-1.9.2.jar:/usr/local/cassandra/bin/../lib/jamm-0.3.0.jar:/usr/local/cassandra/bin/../lib/javax.inject.jar:/usr/local/cassandra/bin/../lib/jbcrypt-0.3m.jar:/usr/local/cassandra/bin/../lib/jcl-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/jflex-1.6.0.jar:/usr/local/cassandra/bin/../lib/jna-4.0.0.jar:/usr/local/cassandra/bin/../lib/joda-time-2.4.jar:/usr/local/cassandra/bin/../lib/json-simple-1.1.jar:/usr/local/cassandra/bin/../lib/libthrift-0.9.2.jar:/usr/local/cassandra/bin/../lib/log4j-over-slf4j-1.7.7.jar:/usr/local/cassandra/bin/../lib/logback-classic-1.1.3.jar:/usr/local/cassandra/bin/../lib/logback-core-1.1.3.jar:/usr/local/cassandra/bin/../lib/lz4-1.3.0.jar:/usr/local/cassandra/bin/../lib/metrics-core-3.1.0.jar:/usr/local/cassandra/bin/../lib/metrics-logback-3.1.0.jar:/usr/local/cassandra/bin/../lib/netty-all-4.0.36.Final.jar:/usr/local/cassandra/bin/../lib/ohc-core-0.4.3.jar:/usr/local/cassandra/bin/../lib/ohc-core-j8-0.4.3.jar:/usr/local/cassandra/bin/../lib/primitive-1.0.jar:/usr/local/cassandra/bin/../lib/reporter-config-base-3.0.0.jar:/usr/local/cassandra/bin/../lib/reporter-config3-3.0.0.jar:/usr/local/cassandra/bin/../lib/sigar-1.6.4.jar:/usr/local/cassandra/bin/../lib/slf4j-api-1.7.7.jar:/usr/local/cassandra/bin/../lib/snakeyaml-1.11.jar:/usr/local/cassandra/

ubuntu 5331 4658 0 15:12 pts/6 00:00:00 grep --color=auto java
ubuntu 15241 15206 0 Jun13 pts/2 00:04:38 /usr/bin/java -server
-Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm/conf
-Xmx1024m -Dlogfile.name=nimbus.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.daemon.nimbus

ubuntu 15242 15211 0 Jun13 pts/4 00:02:26 /usr/bin/java -server
-Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

root 15553 15552 0 Jun13 ? 00:02:27 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

root 19520 19519 0 Jun13 ? 00:03:03 java -server -Ddaemon.name=ui
-Dstorm.options= -Dstorm.home=/usr/local/storm
-Dstorm.log.dir=/usr/local/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib
-Dstorm.conf.file= -cp

/usr/local/storm/lib/clojure-1.7.0.jar:/usr/local/storm/lib/log4j-core-2.1.jar:/usr/local/storm/lib/servlet-api-2.5.jar:/usr/local/storm/lib/log4j-api-2.1.jar:/usr/local/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/local/storm/lib/slf4j-api-1.7.7.jar:/usr/local/storm/lib/minlog-1.3.0.jar:/usr/local/storm/lib/reflectasm-1.10.1.jar:/usr/local/storm/lib/asm-5.0.3.jar:/usr/local/storm/lib/objenesis-2.1.jar:/usr/local/storm/lib/storm-core-1.0.1.jar:/usr/local/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/local/storm/lib/storm-rename-hack-1.0.1.jar:/usr/local/storm/lib/kryo-3.0.3.jar:/usr/local/storm/lib/disruptor-3.3.2.jar:/usr/local/storm:/usr/local/storm/conf
-Xmx768m -Dlogfile.name=ui.log

-DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector
-Dlog4j.configurationFile=/usr/local/storm/log4j2/cluster.xml
org.apache.storm.ui.core

ubuntu 28440 1 0 Jun08 ? 00:07:35 /usr/bin/java -Xmx512M -server
-XX:+UseG1GC -XX:MaxGCPauseMillis=20
-XX:InitiatingHeapOccupancyPercent=35
-XX:+DisableExplicitGC -Djava.awt.headless=true
-Dcom.sun.management.jmxremote
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.ssl=false
-Dkafka.logs.dir=/usr/local/kafka/bin/../logs

-Dlog4j.configuration=file:/usr/local/kafka/bin/../config/tools-log4j.properties
-cp :/usr/local/kafka/bin/../libs/* kafka.tools.ConsoleConsumer
--zookeeper
localhost:2181 --from-beginning --topic yyyyyy

ubuntu 28945 1 0 Jun13 ? 00:04:24 /usr/bin/java -cp

/usr/local/spark/conf/:/usr/local/spark/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/usr/local/spark/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/lib/datanucleus-core-3.2.10.jar
-Xms1g -Xmx1g org.apache.spark.deploy.master.Master --ip ip-172-31-1-5
--port 7077 --webui-port 8080

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <
https://github.com/Interana/eventsim/issues/4#issuecomment-226797393>,
or
mute the thread <

https://github.com/notifications/unsubscribe/AIjLrn65NXM3qECbYVznLEJnK71LRYObks5qMro-gaJpZM4I3-M2

.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
<
https://github.com/notifications/unsubscribe/AEExOsKQyMjkCuvI5xmIZMnOXW_WBZevks5qMsFLgaJpZM4I3-M2

.

Sidi CHANG
Master in Computer Science (Computational Operations Research Track)
College of William and Mary
Williamsburg, VA, United States

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe/AIjLrqAqJ-Ho61W_yNuYXAQ4F1O4qWqyks5qM1V9gaJpZM4I3-M2
.