ricardoalmeida / callysto

Stream processing framework.

Requirements

• cmake
• clang
• libtool
• libstdc++-devel

Rust MSRV

We are using:

cargo 1.60.0 (d1fd9fe 2022-03-01)

Running

With Docker Compose - Nerdctl Compose

1. You need to have docker installation locally. With containerd backend, if you want to bring single node Kafka replacement use:

nerdctl compose up

If you want to bring Confluent Kafka single node. You can:

nerdctl compose -f docker-compose.kafkasn.yml

If you want to bring full blown Confluent Kafka cluster. Use:

nerdctl compose -f docker-compose.kafkacluster.yml

Mind that nerdctl command is interchangeable with docker.

With K8S

1. You need to have K8S installation locally.

cd k8s && kubectl apply -f . && kubectl port-forward svc/redpanda 9092:9092

3. Now you can run the producers in Python.

virtualenv venv
source venv/bin/activate
which pip3 # check that it is pointing to venv
pip3 install aiokafka -U
python examples/producer.py

3. Now you can spawn the double agent example (without durability).

RUST_LOG="info,rdkafka::client=warn" RUST_BACKTRACE=full cargo run --example double-agent

Environment variables passed above is optional, but suggested for development.

callysto's Issues

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Rate-Limited

These updates are currently rate-limited. Click on a checkbox below to force their creation now.

• Update Rust crate pin-project-lite to 0.2.14
• Update Rust crate daemonize to 0.5
• Update Rust crate futures-lite to 1.13
• Update Rust crate rdkafka to 0.36.2
• Update Rust crate rocksdb to 0.22
• Update Rust crate url to 2.5
• Update Rust crate dirs to v5
• Update Rust crate futures-lite to v2
• Update Swatinem/rust-cache action to v2
• Update actions/checkout action to v4
• 🔐 Create all rate-limited PRs at once 🔐

Edited/Blocked

These updates have been manually edited so Renovate will no longer make changes. To discard all commits and start over, click on a checkbox.

• Update Rust crate lever to 0.1.4

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• Update Rust crate libc to 0.2.153
• Update confluentinc/cp-enterprise-control-center Docker tag to v7.1.12
• Update confluentinc/cp-kafka Docker tag to v7.1.12
• Update confluentinc/cp-kafka-rest Docker tag to v7.1.12
• Update confluentinc/cp-ksqldb-cli Docker tag to v7.1.12
• Update confluentinc/cp-ksqldb-server Docker tag to v7.1.12
• Update confluentinc/cp-schema-registry Docker tag to v7.1.12
• Update confluentinc/cp-zookeeper Docker tag to v7.1.12
• Update confluentinc/ksqldb-examples Docker tag to v7.1.12
• Update Rust crate nuclei to 0.4.4
• Click on this checkbox to rebase all open PRs at once

Detected dependencies

cargo

Cargo.toml

• nuclei 0.1.3
• lightproc 0.3.5
• lever 0.1.2
• thiserror 1.0
• async-trait 0.1
• futures 0.3
• futures-timer 3.0
• crossbeam-channel 0.5
• rdkafka 0.28.0
• tracing 0.1
• tracing-subscriber 0.3
• url 2.2
• libc 0.2.122
• cuneiform-fields 0.1
• serde 1.0
• serde_json 1.0
• bincode 1.3
• http-types 2.12
• async-h1 2.3
• pin-project-lite 0.2.8
• futures-lite 1.12
• rocksdb 0.18
• elasticsearch 7.14.0-alpha.1
• daemonize 0.4
• dirs 4.0.0

docker-compose

docker-compose.kafkacluster.yml

• confluentinc/cp-zookeeper 7.1.0
• confluentinc/cp-kafka 7.1.0
• confluentinc/cp-schema-registry 7.1.0
• cnfldemos/kafka-connect-datagen 0.5.0-6.2.0
• confluentinc/cp-ksqldb-server 7.1.0
• confluentinc/cp-ksqldb-cli 7.1.0
• confluentinc/cp-enterprise-control-center 7.1.0
• confluentinc/ksqldb-examples 7.1.0
• confluentinc/cp-kafka-rest 7.1.0

docker-compose.kafkaguisn.yml

docker-compose.kafkasn.yml

docker-compose.yml

dockerfile

docker/Dockerfile

github-actions

.github/workflows/cicd.yml

• actions/checkout v3
• actions-rs/toolchain v1
• Swatinem/rust-cache v1
• actions-rs/cargo v1
• actions-rs/cargo v1
• actions-rs/cargo v1

---

• Check this box to trigger a request for Renovate to run again on this repository