Comments (6)
Why not use logstash for retrieving logs?
This solution has the advantage of offering many formats as input and it's easy to check if logs are compliant (with GROK).
from mozdef.
@2xyo We prefer using heka internally to ship logs. Its lua sandbox + lpeg (kind of special regex implentation) can ship > 100,000 events/sec and allow nice scripting.
This task is rather to create a simple server with very minimal dependencies, ideally just python, that can be used by anyone who wants to send logs to MozDef (developer, IT, etc.) and wants something to emulate MozDef's receiver with debugging features.
from mozdef.
MozDef aims to be agnostic about log shippers, so logstash, nxlog, beaver, heka, rsyslog, fluentd, etc are all shippers we want to support. We use heka internally because it's a mozilla product, but logstash is supported out of the box by pointing logstash to a mozdef front-end http instance.
from mozdef.
Ok, perfect! Thank you for the clarification and for making me discover heka :)
from mozdef.
We have heka config examples ;-)
from mozdef.
heka is deprecated, closing this in favor of ongoing fluentd work tracked in other issues.
from mozdef.
Related Issues (20)
- Alerts stop running if you disable one via web ui
- Docker fails to Connect to D Bus and install Elasticserach HOT 15
- Possible Security Problems
- Use standard boto credential provider chain instead of using configlib
- Unable to install pip requirements on linux HOT 2
- Change Auth0 event stream from cron based log fetch to push AWS EventBridge stream HOT 1
- Standardize "raw" field name and format HOT 4
- Change auth02mozdef from Auth0 logs to Auth0 logstream
- Remove docker cron volume
- ModuleNotFoundError: No module named 'vine.five' HOT 1
- "Discover" panel of Kibana broken with "alerts" and "alerts-*"
- Sentry integration
- esworker.sqs.py has obscured logic regarding detection of message encoding (json vs base64)
- Travis CI free usage ends Dec 3; mozilla repos should switch to other CI platforms
- Tests using token authentication in requests are broken
- Google workspace audit/admin logs
- Error add whatlist for alert
- Does this diagram match the architecture you have in mind? HOT 1
- AWS Changing GuardDuty finding type September 1, 2021 HOT 1
- "make build" fails during meteor build due to expired certificates
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mozdef.