- a masterless, cloud scale, fault tolerant, high performance distributed computation system
- batch and stream hybrid processing model
- exposes an information model for the description and construction of distributed workflows
- Competes against Storm, Cascading, Cascalog, Spark, Map/Reduce, Sqoop, etc
- written in pure Clojure
- Realtime event stream processing
- Continuous computation
- Extract, transform, load
- Data transformation à la map-reduce
- Data ingestion and storage medium transfer
- Data cleaning
Available on Clojars:
[org.onyxplatform/onyx "0.6.0"]
Component | 0.6.x |
master |
---|---|---|
onyx core | ||
onyx-sql | ||
onyx-datomic | ||
onyx-kafka | ||
onyx-durable-queue |
Feeling impatient? Hit the ground running ASAP with the onyx-starter repo and walkthrough. You can also boot into preloaded a Leiningen application template.
- What does Onyx offer?
- Concepts
- Onyx's Architecture and Low Level Design
- APIs
- Functions
- Flow Conditions
- Lifecycles
- Deployment
- Environment
- Peer Configuration
- Information Model
- Scheduling Jobs and Tasks
- Event Subscription
- Plugins
- core.async Internal Plugin
- Logging
- Performance Tuning
- Examples
- Frequently Asked Questions
Code level API documentation can be found here.
Official plugins are vetted by Michael Drogalis. Ensure in your project that plugin versions directly correspond to the same Onyx version (e.g. onyx-core-async
version 0.6.0
goes with onyx
version 0.6.0
). Fixes to plugins can be applied using a 4th versioning identifier (e.g. 0.6.0.1
).
Generate plugin templates through Leiningen with onyx-plugin
.
You can run a dashboard to monitor Onyx cluster activity, found here. Further, you can collect metrics and send them to the dashboard, or anywhere, by using the onyx-metrics plugin.
You can find the latest major release notes here.
Check out the Onyx Google Group.
Feel free to use it anywhere. You can find a few different versions here.
A simple lein midje
will run the full suite, which takes about 15-20 minutes on my quad-core MacBook Pro.
N.B.: Leiningen may complain about not being able to find the Aeron jars on Clojars. If this happens, you'll need to clone and install Aeron and Agrona as follows:
git clone https://github.com/real-logic/Agrona.git
cd Agrona
./gradlew
cd ..
git clone https://github.com/real-logic/Aeron.git
cd Aeron
./gradlew
Contributions are welcome. Please fork the repository and send a pull request to the master branch.
Onyx uses a similiar branching strategy to Clojure itself. Onyx uses semantic versioning, and each minor version gets its own branch. All work is done on master or feature branches and dropped into a major.minor.x branch when it's time to cut a new release. Pull requests into the master branch are welcome.
Anyone who has a patch accepted may request commit rights. Please do so inside the pull request post-merge.
- Michael Drogalis
- Owen Jones
- Bruce Durling
- Malcolm Sparks
- Lucas Bradstreet
- Bryce Blanton
- David Rupp
- sbennett33
- Tyler van Hensbergen
- David Leatherman
The lead for this project is Michael Drogalis, the original creator. You can get me directly at (mjd3089.at.rit.edu) if needed.
Copyright © 2015 Michael Drogalis
Distributed under the Eclipse Public License, the same as Clojure.
YourKit supports open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of YourKit Java Profiler and YourKit .NET Profiler, innovative and intelligent tools for profiling Java and .NET applications.