cb.cljbeat.ottla.producer — com.chartbeat.cljbeat/ottla 0.9-SNAPSHOT

An opinionated wrapper around KafkaProducer.

extract-props-from-options clj

Converts a map of options created by parsing PRODUCER_CLI_OPTIONS into a map of properties for the producer

flush! clj

(flush! prdcr)

Makes all buffered records immediately available to send (even if linger.ms is greater than 0) and blocks until complete.

producer clj

(producer props)

PRODUCER_CLI_OPTIONS clj

A list of cli-option-specs to be used in conjunction with cli/parse-opts and with producer/extract-props-from-options.

PRODUCER_CONFIGURABLES clj

Producer options defined and mapped into PRODUCER_DEFAULT_PROPS (used by producer function) and PRODUCER_CLI_OPTION_SPECS (which can be required for pairing with user-defined cli-options when).

Many options were skipped, I've only added ones that seem useful at this time.

For more detailed descriptions, see: https://kafka.apache.org/documentation/#producerconfigs

PRODUCER_DEFAULT_PROPS clj

The map of default properties created from PRODUCER_CONFIGURABLES

PRODUCER_VALID_PROPS clj

safe-props clj

(safe-props m)

send! clj

(send! prdcr topic key value)

(send! prdcr topic partition key value)

Sends one message with value to the KafkaProducer prdcr on the String topic with the partition determined by key.

The type and then serialization of key and value are dictated by the producer properties key.serializer and value.serializer which are defaulted to StringSerializer and ByteArraySerializer respectively.

DOES NOT GUARANTEE A WRITE.

Returns a future which, after write happens, contains a RecordMetadata. To ensure write to topic, flush! must be called.

send-and-flush-batch! clj

(send-and-flush-batch! prdcr messages)

Combines send! and flush! to send a batch of messages defined by a seq of maps that each have a :topic, :key, :value and optionally a :partition to put the message on.