jackdaw.streams — fundingcircle/jackdaw 0.7.6

Kafka streams protocols.

aggregate clj

(aggregate kgrouped initializer-fn adder-fn)

(aggregate kgrouped initializer-fn aggregator-fn subtractor-fn-or-topic-config)

(aggregate kgrouped
           initializer-fn
           adder-fn
           subtractor-or-merger-fn
           topic-config)

Aggregates values by key into a new KTable.

branch clj

(branch kstream predicate-fns)

Returns a list of KStreams, one for each of the predicate-fns provided.

close clj

(close kafka-streams)

Stops the kafka streams.

count clj

(count kgrouped)

(count kgrouped name)

Counts the number of records by key into a new KTable.

filter clj

(filter kstream predicate-fn)

filter-not clj

(filter-not kstream predicate-fn)

Creates a KStream that consists of all elements that do not satisfy a predicate.

flat-map clj

(flat-map kstream key-value-mapper-fn)

Creates a KStream that will consist of the concatenation of messages returned by calling key-value-mapper-fn on each key/value pair in the input stream.

flat-map-values clj

(flat-map-values kstream value-mapper-fn)

Creates a KStream that will consist of the concatenation of the values returned by calling value-mapper-fn on each value in the input stream.

for-each! clj

(for-each! kstream foreach-fn)

Performs an action on each element of KStream.

global-ktable clj

(global-ktable streams-builder topic-config)

Creates a GlobalKTable that will consist of data from the specified topic.

global-ktable* clj

(global-ktable* globalktable)

Returns the underlying GlobalKTable

group-by clj

(group-by ktable key-value-mapper-fn)

(group-by ktable key-value-mapper-fn topic-config)

Groups the records of this KStream/KTable using the key-value-mapper-fn.

group-by-key clj

(group-by-key kstream)

(group-by-key kstream topic-config)

Groups records with the same key into a KGroupedStream.

join clj

(join ktable other-ktable value-joiner-fn)

Combines the values of the two KTables that share the same key using an inner join.

join-global clj

(join-global kstream global-ktable kv-mapper joiner)

join-windowed clj

(join-windowed kstream other-kstream value-joiner-fn windows)

(join-windowed kstream
               other-kstream
               value-joiner-fn
               windows
               this-topic-config
               other-topic-config)

Combines the values of two streams that share the same key using a windowed inner join.

kafka-streams clj

(kafka-streams builder opts)

Makes a Kafka Streams object.

kgroupedstream* clj

(kgroupedstream* kgroupedstream)

Returns the underlying KGroupedStream object.

kgroupedtable* clj

(kgroupedtable* kgroupedtable)

Returns the underlying KGroupedTable object.

kstream clj

(kstream streams-builder topic-config)

(kstream streams-builder topic-config topic-pattern)

Creates a KStream that will consume messages from the specified topic.

kstream* clj

(kstream* kstream)

Returns the underlying KStream object.

kstreams clj

(kstreams streams-builder topic-configs)

Creates a KStream that will consume messages from the specified topics.

ktable clj

(ktable streams-builder topic-config)

(ktable streams-builder topic-config store-name)

Creates a KTable that will consist of data from the specified topic.

ktable* clj

(ktable* ktable)

Returns the underlying KTable object.

left-join clj

(left-join kstream ktable value-joiner-fn)

(left-join kstream ktable value-joiner-fn this-topic-config other-topic-config)

Creates a KStream from the result of calling value-joiner-fn with each element in the KStream and the value in the KTable with the same key.

left-join-global clj

(left-join-global kstream global-ktable kv-mapper joiner)

left-join-windowed clj

(left-join-windowed kstream other-kstream value-joiner-fn windows)

(left-join-windowed kstream
                    other-kstream
                    value-joiner-fn
                    windows
                    this-topic-config
                    other-topic-config)

Combines the values of two streams that share the same key using a windowed left join.

map clj

(map kstream key-value-mapper-fn)

Creates a KStream that consists of the result of applying key-value-mapper-fn to each key/value pair in the input stream.

map-values clj

(map-values kstream value-mapper-fn)

Creates a KStream that is the result of calling value-mapper-fn on each element of the input stream.

merge clj

(merge kstream other)

outer-join clj

(outer-join ktable other-ktable value-joiner-fn)

Combines the values of two KTables that share the same key using an outer join.

outer-join-windowed clj

(outer-join-windowed kstream other-kstream value-joiner-fn windows)

(outer-join-windowed kstream
                     other-kstream
                     value-joiner-fn
                     windows
                     this-topic-config
                     other-topic-config)

Combines the values of two streams that share the same key using a windowed outer join.

peek clj

(peek kstream peek-fn)

Performs the action defined by peek-fn on each element of the input KStream, returning that stream untransformed.

print! clj

(print! kstream)

Prints the elements of the stream to out.

process! clj

(process! kstream processor-fn state-store-names)

Applies processor-fn to each item in the input stream.

reduce clj

(reduce kgrouped reducer-fn)

(reduce kgrouped reducer-fn subtractor-fn-or-topic-config)

(reduce kgrouped adder-fn subtractor-fn topic-config)

Combines values of a stream by key into a new KTable.

select-key clj

(select-key kstream select-key-value-mapper-fn)

Create a new key from the current key and value.

select-key-value-mapper-fn should be a function that takes a key-value pair, and returns the value of the new key. Here is example multiplies each key by 10:

(fn [[k v]] (* 10 k))

source-topics clj

(source-topics streams-builder)

Gets the names of source topics for the topology.

start clj

(start kafka-streams)

Starts processing.

state clj

(state k-streams)

state->keyword clj

(state->keyword state)

streams-builder clj

(streams-builder)

streams-builder* clj

(streams-builder* streams-builder)

Returns the underlying KStreamBuilder.

suppress clj

(suppress ktable suppressed)

Suppress some updates from this changelog stream

through clj

(through kstream topic-config)

Materializes a stream to a topic, and returns a new KStream that will consume messages from the topic.

to clj

(to kstream topic-config)

Materializes a stream to a topic.

to-kstream clj

(to-kstream ktable)

(to-kstream ktable key-value-mapper-fn)

Converts a KTable to a KStream.

transform clj

(transform kstream transformer-supplier-fn)

(transform kstream transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each key/value in the input stream.

transform-values clj

(transform-values kstream value-transformer-supplier-fn)

(transform-values kstream value-transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each value in the input stream.

window-by-session clj

(window-by-session kgroupedstream window)

Windows the KStream

window-by-time clj

(window-by-time kgroupedstream window)

Windows the KStream