kafka-clj.consumer.workunits — kafka-clj 4.0.3

Internal consumer helper api for receiving and publishing work units to redis The public functions are get-work-unit!, publish-consumed-wu!, publish-error-wu! and publisher-zero-consumed-wu!

get-work-unit! clj

(get-work-unit! {:keys [redis-conn work-queue working-queue shutdown-flag]})

Wait for work to become available in the work queue Adds a :seen key to the work unit with the current milliseconds

publish-consumed-wu! clj

(publish-consumed-wu! state wu offset-read)

sends the wu as ok and the offset read

publish-error-consumed-wu! clj

(publish-error-consumed-wu! state wu)

publish-error-wu! clj

(publish-error-wu! state wu status offset-read)

sends the wu as error status

publish-zero-consumed-wu! clj

(publish-zero-consumed-wu! state wu)

wait-on-work-unit! clj

(wait-on-work-unit! redis-conn queue working-queue shutdown-flag)

Blocks on the redis queue till an item becomes availabe, at the same time the item is pushed to the working queue