Coder Social home page Coder Social logo

aboguszewski-sumo / sumologic-kubernetes-tools Goto Github PK

View Code? Open in Web Editor NEW

This project forked from sumologic/sumologic-kubernetes-tools

0.0 0.0 0.0 594 KB

sumologic-kubernetes-tools

License: Apache License 2.0

Shell 7.08% Ruby 0.29% Go 16.78% Rust 72.31% Makefile 1.16% HCL 0.88% Dockerfile 1.50%

sumologic-kubernetes-tools's Introduction

Sumo Logic Kubernetes Tools GitHub tag

This repository provides set of tools which can be used for debugging and testing sumologic kubernetes collection solution.

All the various tools are packaged into a single container image that is available in the following public registries:

The images are built for the following architectures:

  • linux/amd64
  • linux/arm64/v8

Disclaimer

This toolset is designed for internal usage and it's in development state. We are not giving guarantee of consistency and stability of the application. Inappropriate usage can lead to breaking cluster configuration and/or deployments.

Requirements

Applications

K8S Check

When Sumo Logic Kubernetes Collection is installed already:

$ kubectl run tools \
 -it --rm \
 --restart=Never \
 -n sumologic \
 --serviceaccount='collection-sumologic' \
 --image sumologic/kubernetes-tools \
 -- check

Alternatively, when collection is not installed, the same command can be run for default serviceaccount:

$ kubectl run tools \
 -it --rm \
 --restart=Never \
 --image sumologic/kubernetes-tools \
 -- check

Should provide an output such as:

/var/run/secrets/kubernetes.io/serviceaccount/token exists, size=842
/var/run/secrets/kubernetes.io/serviceaccount/ca.crt exists, size=1025
/var/run/secrets/kubernetes.io/serviceaccount/namespace exists, size=7
/var/run/secrets/kubernetes.io/serviceaccount/namespace contents: default
KUBERNETES_SERVICE_HOST is set
KUBERNETES_SERVICE_PORT is set
POD_NAMESPACE is not set
POD_NAMESPACE env variable:
Kubernetes cluster at 10.96.0.1:443
Running K8S API test
2020/04/21 18:51:45 Kubernetes version: v1.15.5
2020/04/21 18:51:45 Received data for 15 pods in the cluster
pod "diag" deleted

Trace stress-tester

stress-tester is a simple tool that generates a desired number of spans per minute and sends them using Jaeger format

 kubectl run stress-tester \
  -it --rm \
  --restart=Never -n sumologic \
  --image sumologic/kubernetes-tools \
  --serviceaccount='collection-sumologic' \
  --env JAEGER_AGENT_HOST=collection-sumologic-otelcol.sumologic \
  --env JAEGER_AGENT_PORT=6831 \
  --env TOTAL_SPANS=1000000 \
  --env SPANS_PER_MIN=6000 \
  -- stress-tester

Configuration

You can set Jaeger Go client env variables (such as JAEGER_AGENT_HOST or JAEGER_COLLECTOR) and stress-tester specific ones:

  • TOTAL_SPANS (default=10000000) - total number of spans to generate
  • SPANS_PER_MIN (required) - rate of spans per minute (the tester will adjust the delay between iterations to reach such rate)

Customer Trace Tester

customer-trace-tester is a simple tool that generates a desired number of spans and traces and sends them using OpenTelemetry exporters. Traces can be easily found with the service=customer-trace-test-service filter in the Sumo Logic web application.

 kubectl run stress-tester \
  -it --rm \
  --restart=Never -n sumologic \
  --image sumologic/kubernetes-tools \
  --serviceaccount='collection-sumologic' \
  --env COLLECTOR_HOSTNAME=collection-sumologic-otelcol.sumologic \
  --env TOTAL_TRACES=1 \
  --env SPANS_PER_TRACE=10 \
  --env OTLP_HTTP=true \
  --env OTLP_GRPC=true \
  --env ZIPKIN=true \
  --env JAEGER_THRIFT_HTTP=true \
  -- customer-trace-tester

Configuration

You can configure this tool by setting the following env variables:

  • COLLECTOR_HOSTNAME (default=collection-sumologic-otelcol.sumologic) - the hostname/service of OpenTelemetry Collector
  • TOTAL_TRACES (default=1) - total number of traces to generate
  • SPANS_PER_TRACE (default=10) - number of spans per trace
  • OTLP_HTTP (default=true) - should the traces be sent using OTLP HTTP format
  • OTLP_GRPC (default=true) - should the traces be sent using OTLP gRPC format
  • ZIPKIN (default=true) - should the traces be sent using Zipkin format
  • JAEGER_THRIFT_HTTP (default=true) - should the traces be sent using Jaeger Thrift HTTP format

Example output

./customer-trace-tester

2021/07/09 00:32:48 OTLP gRPC Exporter endpoint: collection-sumologic-otelcol.sumologic:4317
2021/07/09 00:32:48 OTLP HTTP Exporter endpoint: collection-sumologic-otelcol.sumologic:4317
2021/07/09 00:32:48 Zipkin Exporter url: http://collection-sumologic-otelcol.sumologic:9411/api/v2/spans
2021/07/09 00:32:48 Jaeger Thrift HTTP Exporter url: http://collection-sumologic-otelcol.sumologic:14268/api/traces
2021/07/09 00:32:48 *******************************
2021/07/09 00:32:48 Sending traces thru otlpHttp exporter
2021/07/09 00:32:48 COLLECTOR_HOSTNAME = collection-sumologic-otelcol.sumologic:4317
2021/07/09 00:32:48 TOTAL_TRACES = 1
2021/07/09 00:32:48 SPANS_PER_TRACE = 10
2021/07/09 00:32:54 *******************************
2021/07/09 00:32:54 Sending traces thru otlpGrpc exporter
2021/07/09 00:32:54 COLLECTOR_HOSTNAME = collection-sumologic-otelcol.sumologic:4317
2021/07/09 00:32:54 TOTAL_TRACES = 1
2021/07/09 00:32:54 SPANS_PER_TRACE = 10
2021/07/09 00:32:59 *******************************
2021/07/09 00:32:59 Sending traces thru zipkin exporter
2021/07/09 00:32:59 COLLECTOR_HOSTNAME = collection-sumologic-otelcol.sumologic:4317
2021/07/09 00:32:59 TOTAL_TRACES = 1
2021/07/09 00:32:59 SPANS_PER_TRACE = 10
2021/07/09 00:33:04 *******************************
2021/07/09 00:33:04 Sending traces thru jaegerThriftHttp exporter
2021/07/09 00:33:04 COLLECTOR_HOSTNAME = collection-sumologic-otelcol.sumologic:4317
2021/07/09 00:33:04 TOTAL_TRACES = 1
2021/07/09 00:33:04 SPANS_PER_TRACE = 10
2021/07/09 00:33:10 *******************************
2021/07/09 00:33:10 Expected number of all traces: 4
2021/07/09 00:33:10 Expected number of spans in single trace: 10
2021/07/09 00:33:10 Expected number of spans for all traces: 40

Receiver-mock

Small tool for mocking sumologic receiver to avoid sending data outside of cluster.

$ kubectl run receiver-mock \
 -it --rm \
 --restart=Never \
 --image sumologic/kubernetes-tools \
 -- receiver-mock --help

More information

K8S Template generator

Generating

Before generating the configuration we recommend to prepare values.yaml file where you will store all your configuration. Alternatively you can replace the file with --set property=value arguments according to helm documentation.

Docker
cat values.yaml | docker run \
  --rm -i sumologic/kubernetes-tools \
  template \
    --namespace '<NAMESPACE>' \
    --name-template 'collection' \
      | tee sumologic.yaml
Kubectl

Minimal supported version of kubectl is 1.14

cat values.yaml | \
  kubectl run tools \
    -i --quiet --rm \
    --restart=Never \
    --image sumologic/kubernetes-tools -- \
    template \
      --namespace '<NAMESPACE>' \
      --name-template 'collection' \
      | tee sumologic.yaml

Applying changes

Due to issues with prometheus operator and CustomResourceDefinitions you should apply them before applying the generated template.

kubectl apply -f https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_alertmanagers.yaml
kubectl apply -f https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_podmonitors.yaml
kubectl apply -f https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_prometheuses.yaml
kubectl apply -f https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_prometheusrules.yaml
kubectl apply -f https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_servicemonitors.yaml
kubectl apply -f https://raw.githubusercontent.com/coreos/prometheus-operator/release-0.38/example/prometheus-operator-crd/monitoring.coreos.com_thanosrulers.yaml

Wait for CRDs to be created. It should take around few seconds.

Apply the generated template:

kubectl apply -f sumologic.yaml

Template dependency configuration

There could be scenarios when you want to get the configuration of the subcharts (prometheus-operator, fluent-bit, etc.).

Command template-dependency takes part of the upstream values.yaml file basing on the given key:

 kubectl run template-dependency \
  -it --quiet --rm \
  --restart=Never -n sumologic \
  --image sumologic/kubernetes-tools \
  -- template-dependency prometheus-operator

This command will return our configuration of prometheus-operator ready to apply for the prometheus-operator helm chart.

You can add additional parameters (like --version=1.0.0) at the end of the command. List of supported arguments is compatible with helm show values.

Kube prometheus mixin configuration

template-prometheus-mixin is a command which generates remoteWrite mixin configuration for the kube prometheus.

 kubectl run template-dependency \
  -it --quiet --rm \
  --restart=Never -n sumologic \
  --image sumologic/kubernetes-tools \
  -- template-prometheus-mixin > kube-prometheus-sumo-logic-mixin.libsonnet

You can add additional parameters (like --version=1.0.0) at the end of the command. List of supported arguments is compatible with helm show values.

Logs generator

Logs generator is a tool for generating logs (text lines) using patterns, which can specify changing parts (words, digits).

kubectl run template-dependency \
  -it --quiet --rm \
  --restart=Never -n sumologic \
  --image sumologic/kubernetes-tools \
  -- logs-generator --help

More information

Interactive mode

The pod can be also run in interactive mode:

$ kubectl run tools \
  -it --rm \
  --restart=Never \
  --image sumologic/kubernetes-tools \
  -- /bin/bash -l

sumologic-kubernetes-tools's People

Contributors

aboguszewski-sumo avatar andrzej-stencel avatar dependabot[bot] avatar frankreno avatar kkujawa-sumo avatar mat-rumian avatar perk-sumo avatar pmalek avatar pmalek-sumo avatar pmm-sumo avatar samjsong avatar sumo-drosiek avatar swiatekm-sumo avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.