pallavidn / prometurbo

Prometurbo

Get metrics from Prometheus for applications, and expose these applications and metrics in JSON format via REST API. The data ingestion framework probe (i.e., DIF Probe) will access the REST API, convert the JSON output to Turbonomic DTO to be consumed by Turbonomic server.

Applications are distinguished by their IP address. For example, each Kubernetes Pod corresponds to one Application.

Currently, Prometurbo can get application metrics and attributes from Prometheus servers that are configured to scape metrices from the following exporters:

• Istio exporter
• Redis exporter
• Cassandra exporter
• WebDriver exporter
• MySQL exporter
• JMX exporter
• Node exporter

The applications to create, as well as the queries to run to get the metrics of those applications are defined in the configmap-prometurbo.yaml file. The configuration can be extended to support more exporters. If you deploy with helm or operator, define additional exporters through extraPrometheusExporters in the value yaml.

Output of Prometurbo: Applications with their metrics

The application metrics are served via REST API at endpoint /metrics. The output JSON format is defined at turbo-go-sdk:

type Topology struct {
	Version    string       `json:"version"`
	Updatetime int64        `json:"updateTime"`
	Scope      string       `json:"scope"`
	Source     string       `json:"source"`
	Entities   []*DIFEntity `json:"topology"`
}

type DIFEntity struct {
	UID                 string                     `json:"uniqueId"`
	Type                string                     `json:"type"`
	Name                string                     `json:"name"`
	HostedOn            *DIFHostedOn               `json:"hostedOn"`
	MatchingIdentifiers *DIFMatchingIdentifiers    `json:"matchIdentifiers"`
	PartOf              []*DIFPartOf               `json:"partOf"`
	Metrics             map[string][]*DIFMetricVal `json:"metrics"`
	partOfSet           set.Set
	hostTypeSet         set.Set
}

Deploy

Follow the deployment instructions at here to deploy Prometurbo and DIFProbe container in the same Pod.