andrewinci / insulator2

A client UI to inspect Kafka topics, consume, produce and much more.

Insulator 2

A tool for devs to debug Kafka based applications and services

Installation

Download the artifact for your operative system from the last release.

Supported OSs:

• MacOS
• Windows 10
• Debian/Ubuntu

Dev

Required tools

• Volta to install the pinned version of yarn and node.
• Rust rust is required to build the tauri backend

Setup on Ubuntu/Debian

Some libraries are required on debian in order to build

sudo apt update
sudo apt install libwebkit2gtk-4.0-dev \
    build-essential \
    curl \
    wget \
    libssl-dev \
    libgtk-3-dev \
    libayatana-appindicator3-dev \
    librsvg2-dev \
    libsasl2-dev \
    cmake

Setup MacOS

Requirements to compile on mac os can be installed with brew

brew install cmake

Setup Windows

Before running the build make sure the following executables are installed and available in env

• Perl
• cmake

Note: Use powershell to run the build commands

Run in dev mode

yarn
yarn tauri dev

Run tests with

yarn test

Spin up a local kafka cluster (RedPanda) for testing

docker run -d --name=redpanda-1 --rm \
    -p 8081:8081 \
    -p 9092:9092 \
    -p 9644:9644 \
    docker.vectorized.io/vectorized/redpanda:latest \
    redpanda start \
    --overprovisioned \
    --smp 1  \
    --memory 1G \
    --reserve-memory 0M \
    --node-id 0 \
    --check=false

The cluster endpoint and the schema registry endpoint to configure in insulator are respectively: 127.0.0.1:9092 and http://127.0.0.1:8081.

Serve documentation with Jekyll

cd docs
bundle exec jekyll serve

Build

To build the application locally run

# Mac OS
yarn tauri build -b dmg
# Windows
yarn tauri build -b msi
# Linux
yarn tauri build -b deb appimage

Logging

Use RUST_LOG="insulator2=debug" to get debug logs in console for the insulator app only.
Use RUST_LOG=debug to enable debug log in any component (kafkard may be very noisy).

Release

Once happy with the latest main branch artifact, release running yarn release. (need the GH_TOKEN)

Recommended IDE Setup

• VS Code + Tauri + rust-analyzer

Credits

• Tauri
• Mantine
• rust-rdkafka

insulator2's Issues

Error parsing keystore

thread 'tokio-runtime-worker' panicked at 'called `Option::unwrap()` on a `None` value', /home/runner/.cargo/registry/src/index.crates.io-6f17d22bba15001f/openssl-0.10.55/src/pkcs12.rs:42:31

Display schema version with message

Is your feature request related to a problem? Please describe.
It would be useful when debugging to see the schema id associated with an avro message, particularly when there are multiple schemas associated with a topic

Describe the solution you'd like
Would be nice to see the schema version alongside the deserialised avro. It's already being extracted from the message to fetch the schema (

insulator2/backend/src/core/avro/avro_to_json.rs

Line 17 in 228beb7

let id = get_schema_id_from_record_header(raw)?;

)

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Will you support kerberos +sasl later?

Will you support kerberos +sasl later?

Bulk operations on schema registry

Is your feature request related to a problem? Please describe.
I'm always frustrated when I need to remove tens of schemas form the server.

Describe the solution you'd like
Select all schemas and remove them in one click.

Support for Ubuntu 20.04

The built artifacts use a version of C libs that's too new for Ubuntu 20.04, so although it installs it won't run

Is the solution for this just to build the project on an older Linux version so it is packaged with earlier C libs? Newer Ubuntu versions like 22 would be backwards compatible?

I tried to build locally following some instructions but couldn't get everything set up right

Error when running:

/usr/bin/insulator-2: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by /usr/bin/insulator-2)
/usr/bin/insulator-2: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.32' not found (required by /usr/bin/insulator-2)
/usr/bin/insulator-2: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by /usr/bin/insulator-2)