fatelei / ilogtail

The Lightweight Data Collector of SLS in Alibaba Cloud

Alibaba iLogtail - The Lightweight Collector of SLS in Alibaba Cloud | 中文版本

iLogtail was born for observable scenarios and has many production-level features such as lightweight, high performance, and automated configuration, which are widely used internally by Alibaba Group and tens of thousands of external Alibaba Cloud customers. You can deploy it in physical machines, Kubernetes and other environments to collect telemetry data, such as logs, traces and metrics.

Abstract

The core advantages of iLogtail :

• Support a variety of Logs, Traces, Metrics data collection, and friendly to container and Kubernetes environment support.
• The resource cost of data collection is quite low, 5-20 times better than similar telemetry data collection Agent performance.
• High stability, used in the production of Alibaba and tens of thousands of Alibaba Cloud customers, and collecting dozens of petabytes of observable data every day with nearly tens of millions deployments.
• Support plugin expansion, such as collection, processing, aggregation, and sending modules.
• Support configuration remote management and provide a variety of ways, such as SLS console, SDK, K8s Operator, etc.
• Supports multiple advanced features such as self-monitoring, flow control, resource control, alarms, and statistics collection.

iLogtail supports the collection of a variety of telemetry data and transmission to a variety of different backends, such as SLS observable platform. The data supported for collection are mainly as follows:

• Logs
  • Collect static log files
  • Dynamic collect the files when running with containerized environment
  • Dynamic collect Stdout when running with containerized environment
• Traces
  • OpenTelemetry protocol
  • Skywalking V2 protocol
  • Skywalking V3 protocol
  • ...
• Metrics
  • Node metrics
  • Process metrics
  • Gpu metrics
  • Nginx metrics
  • Support fetch prometheus metrics
  • Support transfer telegraf metrics
  • ...

Quick Start

This repository is the golang part of iLogtail，it contains most of the features of iLogtail. And, it can work by itself or work with Ilogtail-C(open source soon) using CGO.

1. Start with local

make pluin_main && sh output/ilogtail

NOTE: for some higher linux version, you have to install systemd-devel in advance

#centos
yum install systemd-devel

#ubuntu
apt-get update && apt-get install -y libsystemd-dev

2. Start with Alibaba Cloud
   Please read this doc.

Documentation

For documentation on the latest version see the documentation index

• Input Plugins
• Processor Plugins
• Aggregator Plugins
• Flusher Plugins

Contribution

There are many ways to contribute:

• Fix and report bugs
• Improve Documentation
• Review code and feature proposals
• Contribute plugins

Contact Us

You can report bugs, make suggestions or participate in discussions through Github Issues, or contact us with the following ways:

• DingTalk：iLogtail社区
• WeChat：日志服务
• Bilibili：阿里云SLS
• Zhihu：阿里云日志服务

Our Users

Tens of thousands of companies use iLogtail in Alibaba Cloud, IDC, or other clouds. More details please see here.

Licence

Apache 2.0 License