amannocci / streamy Goto Github PK

Describe the feature

Upgrade to Akka 2.5.7

Describe the feature

Provide only Flow, Source and Sink implementations when possible.
This modification will allow better composition support.

Describe the feature

Support AMQP protocol

Describe the feature

We can support both serialize and deserialize method in Json transformer.

Describe the feature

Implement a Metric plugin to support jvm metric reporting instead of current implementation in Streamy.

Describe the feature

Add support for OpenJDK 11.

https://github.com/akka/akka/issues/25640
https://github.com/akka/akka/issues/25739
https://github.com/akka/akka/pull/25792

Describe the feature

Use Ryu algorithm for float and double printing

Describe the feature

Implement a File plugin that support file reading and writing.
We can also allow directory change detection.
Implementation can be done mostly by using Alpakka File Connector

Describe the feature

Simply upgrade to sbt 1.0.4

Describe the feature

For some use case the current implementation of Syslog parsing is too strict.
In particular when we read a syslog record comming from Docker.

Describe the feature

Support a better error reporting for syslog plugin

Describe the feature

Support structured data in syslog RFC5424

Describe the feature

Support parsing of Gelf format

Describe the feature

Implement a way to read packet compatible with Graphite protocol.

Describe the feature

Simply upgrade to sbt 1.0.3

Expected behavior

We can make Streamy container aware and consume only CPU and Memory available.

Actual behavior

Streamy isn't container aware and attempt to consume all CPU and Memory available on host.

Describe the feature

Basic support of pureconfig for Json stuff.

Describe the feature

Add an Elasticsearch plugin that can read json document using scroll api and write json document using bulk api
Implementation can be based on Akka Http and Sttp
It must support Elasticsearch 2.x up to Elasticsearch 6.x and above

Expected behavior

1. Catch system signal.
2. Perform some cleanup operations at plugin level by simply stopping them.
3. Perform some cleanup operations at streamy level if needed.

Actual behavior

• Undefined

Describe the feature

Migrate from play-json library to circe library.
Circe provide better performance and some support for raw parsing based on ByteBuffer.
We will be able to parse directly from ByteString in for example syslog plugin.

Describe the feature

We can unify testing style for better comprehension

Describe the feature

Upgrade to Akka 2.5.19

Describe the feature

Circe Json AST is now used as a base in term of data structure in Streamy.
This implementation is great but two complex for our needs.
We need a custom Json AST that allow some improvement in some case.
To summarize we need fast operation on AST, serialization and deserialization.
Serialization and deserialization can be support by Jackson.
Access and modification operation can be based on work done in Diffson. We just need a way to evaluate and another to patch Json AST.
For the Json AST we can use the great work done in play-json and just simplify some case for lower memory footprint.
In addition we can provide a way to create efficiently a json object and json array without unnecessary allocation.

AST Target :

• Json => Base of every json value.
• JsObject => Represent an object backed by a mutable map and properly wrapped.
• JsArray => Represent an array backed by a mutable list and properly wrapped.
• JsNull => Represent a null value.
• JsBoolean => Represent a boolean value.
• JsString => Represent a string value.
• JsLong => Represent a long value.
• JsInt => Represent an int value.
• JsDouble => Represent a double value.
• JsFloat => Represent a float value.
• JsBigDecimal => Represent a big decimal value.
• JsBytes => Represent a byte string (Usefull for binary conversion).

Describe the feature

Add documentation using vue-press

Describe the feature

Build a json parser on top of Streamy parser to provide a better parser.
This feature allow to create directly Json AST and permit to remove completely dependencies with Jackson.

Describe the feature

Support autostart for debian.

Describe the feature

We can externalize metrics reporter by converting it in an Akka Stream Source.
We can continue to support console reporting by default and provide a convenient way to process metrics reporting to others Sink.

Describe the feature

Move json stuff in another package and add a package object to provide easy import.
Provide also better support for json evaluation and patch.

Describe the feature

Clarify native packaging support by adding right properties.

Describe the feature

Upgrade to Akka 2.5.10

Describe the feature

We can easily support riemann protocol by using the protobuf plugin

Describe the feature

We can use https://doc.akka.io/docs/akka/current/actors.html#coordinated-shutdown during shutdown phase instead of registering our own hook

Describe the feature

Implement a way to retrieve current plugin state.

Expected behavior

When we use json remove operation with mustExist flag to false we excepted that the operation successed in all cases.

Actual behavior

On json object or json array when we evaluate the json path, the operation is considered as failed if evaluation is failed.

Expected behavior

When we package streamy or a plugin we expect a minimal number of libraries to work.

Actual behavior

Actually JMH is included in every package.

Expected behavior

If envtpl is detected and executed we must ensure that templating has successed.

Actual behavior

Streamy is started even if envtpl failed.

Describe the feature

Upgrade to Akka 2.5.9 and Dropwizard 4.0.2

Expected behavior

Capture should be considered optional in some case when parsing fail.

Actual behavior

Capture is considered as mandatory in every case and fail when parsing fail.

Describe the feature

Add a streamy test project to provide an easy way to import common test libraries.

Describe the feature

We can upgrade some sbt plugins :

• sbt-native-packager
• scalastyle-sbt-plugin
• sbt-scoverage

Describe the feature

We can provide a better plugin management.
Actually, we only load plugins from plugins folder and load plugins configuration from streamy configuration.
We need a separate folder that contains plugins configurations and another one that can contains plugin data if needed.

Describe the feature

Streamy can provide an embedded ByteString parser and an embedded Json printer allowing efficient parsing and printing.

Describe the feature

Currently we use akka framing and then we parse syslog.
This leads to a compact operation when a frame is founded.
We can avoid this compaction if we parse directly the frame.

Describe the feature

We can easily support xymon protocol

Describe the feature

Upgrade to Akka 2.5.8 to avoid memory leaks.

Describe the feature

Provide a json pointer parser that can be used to parse directly json pointer from configuration.

Expected behavior

The field day in the timestamp part can be represent using a single number.
The parser should support this representation.

Actual behavior

The parser isn't able to parse the following example:

<34>Apr  4 13:51:20 mymachine.example.com su[77042]: 'su root' failed for lonvick on /dev/pts/8

Expected behavior

Efficient computation based on underlying structure or primitive.

Actual behavior

Actually we use an intermediate string representation to compute the length.

Describe the feature

Add a CSV parser and printer

Describe the feature

Support TLS over TCP for client and server implementation.
It's mandatory to use where possible Lightbend SSL configuration.