Performance Benchmarks about conduit

[lovromazgon]

Copied over from duplicate:

Create benchmarks that can be executed and measure the performance of Conduit, specifically we are interested in the performance of the pipeline execution (e.g. bytes/s, messages/s). Think about different scenarios (e.g. lots of small messages, a few huge messages, bursts of messages) These tests should give us a good understanding of how changes to Conduit internals impact its performance. In the future we can add a CI job that periodically runs these benchmarks and provides a view into the performance of Conduit over time.

[hariso]

Checklist:

• Ability to run the benchmark manually
• Print msg/s, bytes/s on request
• Verify that pipeline time is correct (i.e. that we have correctly calculated the amount of time records are in the pipeline itself)
• Generator: ability to run multiple sources ConduitIO/conduit-connector-generator#17
• Generator: ability to have bursts: ConduitIO/conduit-connector-generator#20
• Generator: ability to have large payloads ConduitIO/conduit-connector-generator#18
• NoOp destination
• Run the generator as a standalone plugin (we said we're not interested in this)
• Add milliseconds per record in results
• Print results to CSV
• Workload with large files -- script added, but test fails due to #547
• Run all workloads by default
• Assign a fixed amount of resources (CPU, memory) to Docker containers in which tests are run

[hariso]

Code moved to https://github.com/ConduitIO/streaming-benchmarks.

[neovintage]

Complete!