Jackdaw ·

Jackdaw is a Clojure library for the Apache Kafka distributed streaming platform. With Jackdaw, you can create and list topics using the AdminClient API, produce and consume records using the Producer and Consumer APIs, and create stream processing applications using the Streams API. Jackdaw also contains functions to serialize and deserialize records as JSON, EDN, and Avro, as well as functions for writing unit and integration tests.

Maintenance fork. This is a maintained continuation of fundingcircle/jackdaw (unmaintained since 2024), modernized for Apache Kafka 4.x. It is published under a new coordinate, net.clojars.savya/jackdaw. See the CHANGELOG for the 4.x migration notes.

Installation

Leiningen / Boot:

[net.clojars.savya/jackdaw "1.3.2"]

deps.edn:

net.clojars.savya/jackdaw {:mvn/version "1.3.2"}

Jackdaw resolves Confluent artifacts from the Confluent Maven repository; add https://packages.confluent.io/maven/ to your :repositories (Leiningen) or :mvn/repos (deps.edn).

Supported versions

Jackdaw 1.3.2 requires Clojure >= 1.10, JDK 17+, and Apache Kafka 4.x / Confluent Platform 8.x brokers. (The Clojure floor is set by the datafy protocol, introduced in 1.10.)

Documentation

You can find all the documentation on cljdoc.

Examples

• Pipe
• Word Count
• Simple Ledger
• Roll Dice

Contributing

We welcome any thoughts or patches - open an issue on this fork.

Related projects

If you want to get more insight about your topologies, you can use the Topology Grapher library to generate graphs. See an example using jackdaw to check how to integrate it with your topology.

Releasing

This fork self-publishes to Clojars under net.clojars.savya/jackdaw.

1. Bump the version in project.clj and add a dated entry to CHANGELOG.md.
2. Make sure the test suite is green and lein check reports no reflection warnings.
3. Deploy: CLOJARS_USERNAME=<user> CLOJARS_PASSWORD=<clojars-deploy-token> lein deploy clojars.
4. Tag the release: git tag <version> && git push --tags.

License

Copyright © 2017 Funding Circle

Maintenance fork (2026) by Savyasachi; original: https://github.com/fundingcircle/jackdaw

Distributed under the BSD 3-Clause License.