Create package Storm about buildoop

[javiroman]

Some links as guides to make the package:

https://github.com/nmilford/rpm-storm/blob/master/storm.spec
https://github.com/nttdata-oss/storm-rpms
https://github.com/ashrithr/rpm-specs/tree/master/storm-0.8
https://github.com/rfliam/storm-rhel-packaging
https://github.com/acromusashi/storm-installer
https://github.com/nmilford/rpm-storm

[javiroman]

Ready for test:

commit a6cb00f

[javiroman]

The package is ready to test. Runtime issues here please.

[javiroman]

According with Nathan Marz documentation [1]. The Storm Cluster has native dependencies:

ZeroMQ and JZMQ.

ZeroMQ is packed by community repositories like EPEL (zeromq.x86_64 2.2.0-4.el6). However JZMQ is not GA packed right now, besides the fact that Nathan Marz maintain a frozen JZMQ fork which is tested to work with Storm [2].

So we have to make in Buildoop a jzmqstorm package in order to solve the dependencies.

[1] https://github.com/nathanmarz/storm/wiki/Installing-native-dependencies
[2] https://github.com/nathanmarz/jzmq

[javiroman]

In addition to this native dependencies, we have to create a zeromq 2.1.7 package because with the current Storm version seems to have compatibility issues with later versions of zeromq.

This strong dependencies can be avoid using the new Storm’s Netty transport layer [1].

We are going to support both flavors.

[1] https://storm.incubator.apache.org/2013/12/08/storm090-released.html

[javiroman]

The package is ready for testing:

1. Testing with Netty transport:

To configure Storm to use the Netty transport simply add the following to your storm.yaml configuration and adjust the values to best suit your use-case:

storm.messaging.transport: "backtype.storm.messaging.netty.Context"
storm.messaging.netty.server_worker_threads: 1
storm.messaging.netty.client_worker_threads: 1
storm.messaging.netty.buffer_size: 5242880
storm.messaging.netty.max_retries: 100
storm.messaging.netty.max_wait_ms: 1000
storm.messaging.netty.min_wait_ms: 100

1. Testing with old-native support:

yum install jzmqstorm

[javiroman]

Package status:

1. Storm has hardcode some variables in the /usr/bin/storm Python executable. Those variables have to move to the classical location /etc/default/storm. The executable must be patch for use os.getenv("VARIABLE") sentence.
2. The init script must be takes into account the sourcing of /etc/default/storm
3. Storm look for the set of .jar files placed into /usr/lib/storm/lib. The current location /usr/lib/storm/.jar must be moved.

[javiroman]

The package mus be reworked (start and stop daemons) however the basic functionality is working.

In commit 226a4f7