observIQ’s distribution of the OpenTelemetry collector providing a simple and unified solution to collect, refine, and ship telemetry data anywhere
License: Apache License 2.0
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
Currently only a tiny subset of options are supported, and we have a customer in PoC wanting to specify more of them. Specifically the include_file_name and include_file_path options.
Service 'observIQ Distro for OpenTelemetry Collector' (observiq-otel-collector) failed to start, Verify that youhave sufficient privileges to start system services.
I ran it as an administrator.
OS: Windows Server 2008
The list of receivers shows the otel name for the receiver. A more useful list would be in table form and include the otel name as well as the human-readable name and possibly icon. Helpful for the user scanning for the integration they're looking for. Same with exporters, processors, etc
This is a two part issue to create parity among our products.
The first part is extremely important for doing offline installs using the script in locked down environments
Please can we add support for building containers for ARMv7 and ARM64?
I'd love to get this running on a Raspberry Pi via Docker Compose!
I'm using the Balena.io platform for fleet management and that doesn't seem to like the arm64 images
HI,
Please include azuredataexplorer exporter into your distro releases.
It is included in collector releases in contrib repository, but it would be great if it was included in observIQ distro as well.
Thanks
Hi guys.
First of all thanks a lot for great collector distribution.
In contrib collector there is a connector functionality available.
Althougt it is current in development phase it would be great to have it in this distribution.
Logs with quotes in them are not parsed correctly. The issue was resolved by adding lazy_quotes: true into the plugin file under the csv_parser.
in the base README we show a complex configuration file. Update this to a simple config to make it easier for those just getting started to understand
Customer using the MongoDB Atlas receiver is getting a panic when attempting to use the receiver with events collection enabled.
Log Snippet:
{"level":"fatal","ts":"2023-03-02T20:38:33.088Z","caller":"collector/main.go:113","msg":"RunService returned error","error":"failed to start service: failed while starting collector: collector panicked with error: runtime error: invalid memory address or nil pointer dereference. Panic stacktrace: goroutine 91 [running]:\nruntime/debug.Stack()\n\t/opt/hostedtoolcache/go/1.19.6/x64/src/runtime/debug/stack.go:24 +0x65\ngithub.com/observiq/observiq-otel-collector/collector.(*collector).Run.func1.1()\n\t/home/runner/work/observiq-otel-collector/observiq-otel-collector/collector/collector.go:114 +0x5d\npanic({0x55a7e60, 0xaaa9370})\n\t/opt/hostedtoolcache/go/1.19.6/x64/src/runtime/panic.go:884 +0x212\ngithub.com/open-telemetry/opentelemetry-collector-contrib/receiver/mongodbatlasreceiver.(*eventsReceiver).checkpoint(0xc00124e320, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/events.go:235](mailto:t/home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/events.go:235) +0x90\ngithub.com/open-telemetry/opentelemetry-collector-contrib/receiver/mongodbatlasreceiver.(*eventsReceiver).Shutdown(0xc00124e320, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/events.go:117](mailto:t/home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/events.go:117) +0x85\ngithub.com/open-telemetry/opentelemetry-collector-contrib/receiver/mongodbatlasreceiver.(*combinedLogsReceiver).Shutdown(0xc00124b398, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/combined_logs.go:73](mailto:t/home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/combined_logs.go:73) +0xdd\ngo.opentelemetry.io/collector/service.(*pipelinesGraph).ShutdownAll(0x0?, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/service/graph.go:296](mailto:t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/service/graph.go:296) +0xc9\ngo.opentelemetry.io/collector/service.(*Service).Shutdown(0xc00019a600, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/service/service.go:172](mailto:t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/service/service.go:172) +0xd9\ngo.opentelemetry.io/collector/otelcol.(*Collector).setupConfigurationComponents(0xc000a26300, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/otelcol/collector.go:183](mailto:t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/otelcol/collector.go:183) +0x628\ngo.opentelemetry.io/collector/otelcol.(*Collector).Run(0xc000a26300, {0x6fa40d8, 0xc0000d2280})\n\[t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/otelcol/collector.go:207](mailto:t/home/runner/go/pkg/mod/go.opentelemetry.io/[email protected]/otelcol/collector.go:207) +0x65\ngithub.com/observiq/observiq-otel-collector/collector.(*collector).Run.func1()\n\t/home/runner/work/observiq-otel-collector/observiq-otel-collector/collector/collector.go:131 +0xc5\ncreated by github.com/observiq/observiq-otel-collector/collector.(*collector).Run\n\t/home/runner/work/observiq-otel-collector/observiq-otel-collector/collector/collector.go:107 +0x512\n","stacktrace":"main.main\n\t/home/runner/work/observiq-otel-collector/observiq-otel-collector/cmd/collector/main.go:113\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.6/x64/src/runtime/proc.go:250"}
{"level":"info","ts":"2023-03-02T20:38:38.322Z","caller":"collector/main.go:104","msg":"Starting Standalone Mode"}
{"level":"info","ts":"2023-03-02T20:38:38.327Z","caller":"service/telemetry.go:90","msg":"Setting up own telemetry..."}
{"level":"info","ts":"2023-03-02T20:38:38.327Z","caller":"service/telemetry.go:116","msg":"Serving Prometheus metrics","address":":8888","level":"Basic"}
{"level":"info","ts":"2023-03-02T20:38:38.330Z","caller":[[email protected]/metrics.go:97](mailto:[email protected]/metrics.go:97),"msg":"Me
[config-events.txt](https://github.com/observIQ/observiq-otel-collector/files/10883411/config-events.txt)
tric filter configured","kind":"processor","name":"filter","pipeline":"metrics","include match_type":"strict","include expressions":[],"include metric names":[],"include metrics with resource attributes":[{"Key":"mongodb_atlas.project.name","Value":"Login PoC Sandbox"}],"exclude match_type":"","exclude expressions":[],"exclude metric names":[],"exclude metrics with resource attributes":null}
{"level":"info","ts":"2023-03-02T20:38:38.331Z","caller":"service/service.go:140","msg":"Starting /opt/observiq-otel-collector/observiq-otel-collector...","Version":"v1.19.0","NumCPU":4}
{"level":"info","ts":"2023-03-02T20:38:38.331Z","caller":"extensions/extensions.go:41","msg":"Starting extensions..."}
{"level":"info","ts":"2023-03-02T20:38:38.331Z","caller":"extensions/extensions.go:44","msg":"Extension is starting...","kind":"extension","name":"file_storage"}
{"level":"info","ts":"2023-03-02T20:38:38.331Z","caller":"extensions/extensions.go:48","msg":"Extension started.","kind":"extension","name":"file_storage"}
{"level":"info","ts":"2023-03-02T20:38:39.290Z","caller":"service/service.go:166","msg":"Starting shutdown..."}
I'm trying to ingest entries from all the windows event log channels, not just application. I have setup the following config
receivers:
windowseventlog:
channel: application
windowseventlog/system:
channel: system
windowseventlog/security:
channel: security
service:
pipelines:
logs:
receivers: [windowseventlog,windowseventlog/system,windowseventlog/security]
processors: [batch]
exporters: [logging]The collector crashes on startup with the following error:
❯ .\observiq-otel-collector.exe --config=config.yaml
2022/12/08 09:34:07 proto: duplicate proto type registered: jaeger.api_v2.PostSpansRequest
2022/12/08 09:34:07 proto: duplicate proto type registered: jaeger.api_v2.PostSpansResponse
{"level":"info","ts":"2022-12-08T09:34:09.522-0500","caller":"collector/main.go:99","msg":"Starting Standalone Mode"}
{"level":"info","ts":"2022-12-08T09:34:09.538-0500","caller":"service/telemetry.go:111","msg":"Setting up own telemetry..."}
{"level":"info","ts":"2022-12-08T09:34:09.538-0500","caller":"service/telemetry.go:141","msg":"Serving Prometheus metrics","address":":8888","level":"Basic"}
{"level":"info","ts":"2022-12-08T09:34:09.539-0500","caller":"components/components.go:30","msg":"Development component. May change in the future.","kind":"exporter","data_type":"logs","name":"logging","stability":"Development"}
{"level":"info","ts":"2022-12-08T09:34:09.539-0500","caller":"components/components.go:30","msg":"Development component. May change in the future.","kind":"exporter","data_type":"metrics","name":"logging","stability":"Development"}
{"level":"info","ts":"2022-12-08T09:34:09.540-0500","caller":"service/service.go:89","msg":"Starting C:\\Users\\jpenniman\\Downloads\\observiq-otel-collector-v1.13.0-windows-amd64\\observiq-otel-collector.exe...","Version":"v1.13.0","NumCPU":8}
{"level":"info","ts":"2022-12-08T09:34:09.540-0500","caller":"extensions/extensions.go:41","msg":"Starting extensions..."}
{"level":"info","ts":"2022-12-08T09:34:09.540-0500","caller":"pipelines/pipelines.go:74","msg":"Starting exporters..."}
{"level":"info","ts":"2022-12-08T09:34:09.540-0500","caller":"pipelines/pipelines.go:78","msg":"Exporter is starting...","kind":"exporter","data_type":"logs","name":"logging"}
{"level":"info","ts":"2022-12-08T09:34:09.540-0500","caller":"pipelines/pipelines.go:82","msg":"Exporter started.","kind":"exporter","data_type":"logs","name":"logging"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:78","msg":"Exporter is starting...","kind":"exporter","data_type":"metrics","name":"logging"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:82","msg":"Exporter started.","kind":"exporter","data_type":"metrics","name":"logging"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:86","msg":"Starting processors..."}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:90","msg":"Processor is starting...","kind":"processor","name":"batch","pipeline":"logs"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:94","msg":"Processor started.","kind":"processor","name":"batch","pipeline":"logs"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:90","msg":"Processor is starting...","kind":"processor","name":"batch","pipeline":"metrics"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:94","msg":"Processor started.","kind":"processor","name":"batch","pipeline":"metrics"}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:98","msg":"Starting receivers..."}
{"level":"info","ts":"2022-12-08T09:34:09.541-0500","caller":"pipelines/pipelines.go:102","msg":"Receiver is starting...","kind":"receiver","name":"hostmetrics","pipeline":"metrics"}
{"level":"info","ts":"2022-12-08T09:34:09.671-0500","caller":"pipelines/pipelines.go:106","msg":"Receiver started.","kind":"receiver","name":"hostmetrics","pipeline":"metrics"}
{"level":"info","ts":"2022-12-08T09:34:09.671-0500","caller":"pipelines/pipelines.go:102","msg":"Receiver is starting...","kind":"receiver","name":"windowseventlog/security","pipeline":"logs"}
{"level":"info","ts":"2022-12-08T09:34:09.671-0500","caller":"adapter/receiver.go:55","msg":"Starting stanza receiver","kind":"receiver","name":"windowseventlog/security","pipeline":"logs"}
{"level":"info","ts":"2022-12-08T09:34:09.673-0500","caller":"service/service.go:115","msg":"Starting shutdown..."}
{"level":"info","ts":"2022-12-08T09:34:09.673-0500","caller":"pipelines/pipelines.go:118","msg":"Stopping receivers..."}
{"level":"info","ts":"2022-12-08T09:34:09.674-0500","caller":"adapter/receiver.go:145","msg":"Stopping stanza receiver","kind":"receiver","name":"windowseventlog/system","pipeline":"logs"}
{"level":"fatal","ts":"2022-12-08T09:34:09.674-0500","caller":"collector/main.go:108","msg":"RunService returned error","error":"failed to start service: failed while starting collector: collector panicked with error: runtime error: invalid memory address or nil pointer dereference","stacktrace":"main.main\n\t/home/runner/work/observiq-otel-collector/observiq-otel-collector/cmd/collector/main.go:108\nruntime.main\n\t/opt/hostedtoolcache/go/1.18.8/x64/src/runtime/proc.go:250"}I am using kubernetes node bindplane agent to collect my dotnet core app. I configured a opentelemetry (OTLP) processor to retrieve log/metrics/traces. I could see log and metrics were successfully received in bindplane ops agent; however, the trace information is missing.
I sniffed the packet and confirmed the traceparent information is properly generated in the http header but my bindplane ops agent showed no traces was received from the app.
My bindplane version is 1.36.0
https://github.com/observIQ/observiq-otel-collector/blob/main/docs/receivers.md
The wrong word is used. It should be "their".
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.