jackdaw.streams.extras
FIXME
FIXME
dedupe-byclj
(dedupe-by kstream dedupe-store-name unique-key-fn dedupe-notifier-fn)Filters out any messages in the stream already seen. Seen keys are
held in a state store. Key to use for de-duping is accessed via
unique-key-fn, which is passed a vector of [k v]
If dedupe-notifier-fn is set, it is called with [k v] when a
message is dropped from the stream. Typically this would be used to
pass in logging for dropped messages.
Filters out any messages in the stream already seen. Seen keys are held in a state store. Key to use for de-duping is accessed via `unique-key-fn`, which is passed a vector of `[k v]` If `dedupe-notifier-fn` is set, it is called with `[k v]` when a message is dropped from the stream. Typically this would be used to pass in logging for dropped messages.
dedupe-by-fieldclj
(dedupe-by-field kstream dedupe-store-name key-fn)(dedupe-by-field kstream dedupe-store-name key-fn dedupe-notifier-fn)Filters out any messages in the stream already seen. Seen keys are
held in a state store. Uses the result of applying key-fn to the
stream's value for deduping.
Filters out any messages in the stream already seen. Seen keys are held in a state store. Uses the result of applying `key-fn` to the stream's value for deduping.
dedupe-by-keyclj
(dedupe-by-key kstream dedupe-store-name)(dedupe-by-key kstream dedupe-store-name dedupe-notifier-fn)Filters out any messages in the stream already seen. Seen keys are held in a state store. Uses the stream's key for deduping.
Filters out any messages in the stream already seen. Seen keys are held in a state store. Uses the stream's key for deduping.
logging-state-restore-listenerclj
(logging-state-restore-listener)Returns a new Kafka StateRestoreListener instance which logs when
batches are restored, and how long it takes to restore all the
batches for a given partition.
Returns a new Kafka `StateRestoreListener` instance which logs when batches are restored, and how long it takes to restore all the batches for a given partition.
seen!?clj
(seen!? state-store dedupe-key)Returns true if dedupe-key is already present in state-store.
Otherwise returns false, and adds the key to the state-store.
Returns true if `dedupe-key` is already present in state-store. Otherwise returns false, and adds the key to the state-store.
throughcljmacro
(through builder topic topic-spec)(through builder partition-fn topic topic-spec)Wraps #'jackdaw.streams/through, providing validation of records
against the spec of the through topic.
Wraps `#'jackdaw.streams/through`, providing validation of records against the spec of the through topic.
to!cljmacro
(to! builder topic topic-spec)(to! builder partition-fn topic topic-spec)Wraps #'jackdaw.streams/to!, providing validation of records
against the spec of the to! topic.
Wraps `#'jackdaw.streams/to!`, providing validation of records against the spec of the to! topic.
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close