Liking cljdoc? Tell your friends :D

ziggurat.producer

This namespace defines methods for publishing data to Kafka topics. The methods defined here are essentially wrapper around variants of send methods defined in org.apache.kafka.clients.producer.KafkaProducer.

At the time of initialization, an instance of org.apache.kafka.clients.producer.KafkaProducer is constructed using config values provided in resources/config.edn.

A producer can be configured for each of the stream-routes in config.edn. Please see the example below

` :stream-router {:default {:application-id "test"

                         :bootstrap-servers    "localhost:9092"

                         :stream-threads-count [1 :int]

                         :origin-topic         "topic"

                         :channels             {:channel-1 {:worker-count [10 :int]

:retry {:count [5 :int] :enabled [true :bool]}}}

                         :producer             {:bootstrap-servers "localhost:9092"

                                                :acks "all"

                                                :retries-config  5

                                                :max-in-flight-requests-per-connection 5

                                                :enable-idempotence  false

                                                :value-serializer  "org.apache.kafka.common.serialization.StringSerializer"

                                                :key-serializer    "org.apache.kafka.common.serialization.StringSerializer"}}

`

Usage:

Please seesendfor publishing data via Kafka producers

These are the KafkaProducer configs currenlty supported in Ziggurat.

  • bootstrap.servers
  • acks
  • retries
  • key.serializer
  • value.serializer
  • max.in.flight.requests.per.connection
  • enable.idempotencecd

Please see Producer configs for a complete list of all producer configs available in Kafka.

This namespace defines methods for publishing data to
 Kafka topics. The methods defined here are essentially wrapper
 around variants of `send` methods defined in
 `org.apache.kafka.clients.producer.KafkaProducer`.

 At the time of initialization, an instance of
 `org.apache.kafka.clients.producer.KafkaProducer`
 is constructed using config values provided in `resources/config.edn`.

 A producer can be configured for each of the stream-routes
 in config.edn. Please see the example below

 `
   :stream-router {:default {:application-id "test"

                             :bootstrap-servers    "localhost:9092"

                             :stream-threads-count [1 :int]

                             :origin-topic         "topic"

                             :channels             {:channel-1 {:worker-count [10 :int]
:retry {:count [5 :int]
:enabled [true :bool]}}}

                             :producer             {:bootstrap-servers "localhost:9092"

                                                    :acks "all"

                                                    :retries-config  5

                                                    :max-in-flight-requests-per-connection 5

                                                    :enable-idempotence  false

                                                    :value-serializer  "org.apache.kafka.common.serialization.StringSerializer"

                                                    :key-serializer    "org.apache.kafka.common.serialization.StringSerializer"}}
 `

 Usage:

 `
    Please see `send` for publishing data via Kafka producers
 `

 These are the KafkaProducer configs currenlty supported in Ziggurat.
 - bootstrap.servers
 - acks
 - retries
 - key.serializer
 - value.serializer
 - max.in.flight.requests.per.connection
 - enable.idempotencecd

 Please see [Producer configs](http://kafka.apache.org/documentation.html#producerconfigs)
 for a complete list of all producer configs available in Kafka.
raw docstring

ziggurat.sentry

Sentry reporting functions used by both Ziggurat and the actor.

Sentry reporting functions used by both Ziggurat and the actor.
raw docstring

cljdoc is a website building & hosting documentation for Clojure/Script libraries

× close