Onyx

A fork of onyx-platform/onyx updated to run with JDK-21

Include in project:

Available on Clojars

Insert this line into your project.clj if using Leiningen.

[com.github.clojure-finance/onyx "0.16.0"]

JVM requirements

This fork runs on JDK 17 or newer (JDK 21 is what it is tested on). It uses Aeron 1.53.x, whose bundled Agrona reads jdk.internal.misc.Unsafe, so the JVM that starts Onyx peers needs this flag:

--add-opens=java.base/jdk.internal.misc=ALL-UNNAMED

With Leiningen put it in :jvm-opts; on the command line pass it to java directly. Without it the embedded media driver fails to start with IllegalAccessError: class org.agrona.UnsafeApi ... cannot access class jdk.internal.misc.Unsafe. The sun.nio.ch and java.lang opens that earlier versions of this fork needed are no longer required.

Changes made:

Updated dependencies (including Aeron 1.53.1), renamed internal components and fixed certain tests. See changes.md for details per version.

What is it?

a masterless, cloud scale, fault tolerant, high performance distributed computation system
batch and stream hybrid processing model
exposes an information model for the description and construction of distributed workflows
Competes against Storm, Flink, Cascading, Cascalog, Spark, Map/Reduce, Sqoop, etc
written in pure Clojure

What would I use this for?

Realtime event stream processing
CQRS
Continuous computation
Extract, transform, load
Data transformation à la map-reduce
Data ingestion and storage medium transfer
Data cleaning

Changelog

Changelog can be found at changes.md.

Quick Lookup Doc

A searchable set of documentation for the Onyx data model is available.

Project Template

A project template can be found at onyx-template.

Plugins and Libraries

Plugin Template

We provide a plugin template for use in building new plugins. This can be found at onyx-plugin.

Plugin Use

To use the supported plugins, please use version coordinates such as [org.onyxplatform/onyx-amazon-sqs "0.14.6.SNAPSHOT.0"], and read the READMEs on the 0.14.x branches linked in the plugin listing below.

Unsupported plugins

Some plugins are currently unsupported in onyx 0.14.x. These are:

Companies Running Onyx in Production

Quick Start Guide

Feeling impatient? Hit the ground running ASAP with the onyx-starter repo and walkthrough. You can also boot into preloaded a Leiningen application template.

User Guide 0.14.6

Developer's Guide 0.14.6

API Docs 0.14.6

Code level API documentation can be found here.

Official plugin listing

Official plugins are vetted by Michael Drogalis. Ensure in your project that plugin versions directly correspond to the same Onyx version (e.g. onyx-kafka version 0.14.6.0-SNAPSHOT goes with onyx version 0.14.6). Fixes to plugins can be applied using a 4th versioning identifier (e.g. 0.14.6.1-SNAPSHOT).

Generate plugin templates through Leiningen with onyx-plugin.

3rd Party plugin listing

Unofficial plugins have not been vetted.

onyx-rethink

Need help?

Check out the Onyx Google Group.

Want the logo?

Feel free to use it anywhere. You can find a few different versions here.

Running the tests

A simple lein test will run the full suite for Onyx core.

Contributor list

Acknowledgements

Some code has been incorporated from the following projects:

License

Distributed under the Eclipse Public License, the same as Clojure.

Can you improve this documentation? These fine people already did:
Lucas Bradstreet, Michael Drogalis, Matt Buehlmaier, Leon Mergen, Karanveer Singh, David Rupp, Andrea Crotti, KARASZI István, Jason Bell, Bridget Hillyer, Gardner Vickers, The Alchemist, The Gitter Badger & Owen JonesEdit on GitHub

`Ctrl`+`k`	Jump to recent docs
`←`	Move to previous article
`→`	Move to next article
`Ctrl`+`/`	Jump to the search field