grete.streams — tolitius/grete 0.1.8003

cleanup-streams clj

(cleanup-streams streams)

describe-topology clj

(describe-topology streams)

filter-kv clj

(filter-kv fun)

(filter-kv fun stream)

for-each clj

(for-each fun)

(for-each fun stream)

you would use foreach to cause side effects based on the input data (similar to peek) and then stop further processing of the input data (unlike peek, which is not a terminal operation)

int-serde clj

(int-serde)

left-join clj

(left-join fun)

(left-join fun stream table)

long-serde clj

(long-serde)

make-streams clj

(make-streams config builder)

map-kv clj

(map-kv fun)

(map-kv fun stream)

map-values clj

(map-values fun)

(map-values fun stream)

named-as clj

(named-as op f)

peek clj

(peek fun)

(peek fun stream)

performs a stateless action on each record, and returns an unchanged stream. (details) you would use peek to cause side effects based on the input data (similar to foreach) and continue processing the input data (unlike foreach, which is a terminal operation) peek returns the input stream as-is; if you need to modify the input stream, use map or mapValues instead peek is helpful for use cases such as logging or tracking metrics or for debugging and troubleshooting

start-streams clj

(start-streams streams)

stop-streams clj

(stop-streams streams)

stream->topic clj

(stream->topic stream topic)

(stream->topic stream
               topic
               {:keys [key-serde value-serde]
                :or {key-serde (string-serde) value-serde (string-serde)}})

stream-builder clj

(stream-builder)

stream-on! clj

(stream-on! config make-topology)

string-serde clj

(string-serde)

to-kv clj

(to-kv [k v])

to-stream-config clj

(to-stream-config m)

to-stream-prop clj

(to-stream-prop prop)

topic->global-table clj

(topic->global-table builder topic)

(topic->global-table builder
                     topic
                     {:keys [key-serde value-serde]
                      :or {key-serde (string-serde)
                           value-serde (string-serde)}})

topic->stream clj

(topic->stream builder topic)

(topic->stream builder
               topic
               {:keys [key-serde value-serde]
                :or {key-serde (string-serde) value-serde (string-serde)}})

topic->table clj

(topic->table builder topic)

(topic->table builder
              topic
              {:keys [key-serde value-serde]
               :or {key-serde (string-serde) value-serde (string-serde)}})

transform clj

(transform builder streams)

for single topic to topic streams takes one or more kafka stream functions: map-kv, map-values, filter-kv, etc. applies them on a stream from one topic to another

(transform builder [{:from "foo-topic" :to "bar-topc" :via (k/map-kv some-fn-that-takes-k-and-v)} {:from "baz-topic" :to "moo-topc" :via [(k/map-values some-fn-that-takes-value) (k/filter-kv some-fn-that-takes-k-and-v-and-returns-boolean)]} {:from "zoo-topic" :via (k/for-each some-fn-that-takes-k-and-v)}])