cb.cljbeat.ottla.consumer — com.chartbeat.cljbeat/ottla 0.9-SNAPSHOT

An opinionated wrapper around KafkaConsumer.

-make-consumer clj

(-make-consumer props parts)

commit! clj

(commit! cnsmr)

Light wrapper around KafkaConsumer.commitSync. Commits the youngest offset of the most recently 'poll'ed messages for each partition.

consumer clj

(consumer props topic parts)

Returns a consumer with properities, props, and assigns it to partitions, part, for broker topic, topic.

CONSUMER_CLI_OPTIONS clj

A list of cli-option-specs to be used in conjunction with cli/parse-opts and with consumer/extract-props-from-options.

CONSUMER_CONFIGURABLES clj

Consumer options defined and mapped into CONSUMER_DEFAULT_PROPS (used by consumer function) and CONSUMER_CLI_OPTION_SPECS (automatically used by ottla/start).

Many options were skipped, I've only added ones that seem useful at this time.

For more detailed descriptions, see: https://kafka.apache.org/documentation/#newconsumerconfigs

CONSUMER_DEFAULT_PROPS clj

The map of default properties created from CONSUMER_CONFIGURABLES

consumers clj

(consumers n props topic parts)

Like consumer, but returns a vector of n consumers with partitions, parts, split evenly among them. See consumer.

DEFAULT_POLL_TIMEOUT_MS clj

Default timeout in ms for poll.

extract-props-from-options clj

Converts a map of options created by parsing CONSUMER_CLI_OPTIONS into a map of properties for the consumer.

poll! clj

(poll! cnsmr)

(poll! cnsmr timeout-ms)

Light wrapper arround KafkaConsumer.poll. Returns a lazy seq of maps