jackdaw.streams — fundingcircle/jackdaw 0.7.5-more_interop-SNAPSHOT

Kafka streams protocols.

aggregate clj

(aggregate kgrouped initializer-fn adder-fn)

(aggregate kgrouped initializer-fn aggregator-fn subtractor-fn-or-topic-config)

(aggregate kgrouped
           initializer-fn
           adder-fn
           subtractor-or-merger-fn
           topic-config)

Aggregates values by key into a new KTable.

branch clj

(branch kstream predicate-fns)

Returns a list of KStreams, one for each of the predicate-fns provided.

close clj

(close kafka-streams)

Stops the kafka streams.

count clj

(count kgrouped)

(count kgrouped name)

Counts the number of records by key into a new KTable.

filter clj

(filter kstream predicate-fn)

filter-not clj

(filter-not kstream predicate-fn)

Creates a KStream that consists of all elements that do not satisfy a predicate.

flat-map clj

(flat-map kstream key-value-mapper-fn)

Creates a KStream that will consist of the concatenation of messages returned by calling key-value-mapper-fn on each key/value pair in the input stream.

flat-map-values clj

(flat-map-values kstream value-mapper-fn)

Creates a KStream that will consist of the concatenation of the values returned by calling value-mapper-fn on each value in the input stream.

flat-transform clj

(flat-transform kstream transformer-supplier-fn)

(flat-transform kstream transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each value in the input stream. Result of the transform should be iterable, and the resulting stream is as per flatMap

flat-transform-values clj

(flat-transform-values kstream value-transformer-supplier-fn)

(flat-transform-values kstream value-transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each value in the input stream. Result of the transform should be iterable, and the resulting stream is as per flatMap

for-each! clj

(for-each! kstream foreach-fn)

Performs an action on each element of KStream.

global-ktable clj

(global-ktable streams-builder topic-config)

Creates a GlobalKTable that will consist of data from the specified topic.

global-ktable* clj

(global-ktable* globalktable)

Returns the underlying GlobalKTable

group-by clj

(group-by ktable key-value-mapper-fn)

(group-by ktable key-value-mapper-fn topic-config)

Groups the records of this KStream/KTable using the key-value-mapper-fn.

group-by-key clj

(group-by-key kstream)

(group-by-key kstream topic-config)

Groups records with the same key into a KGroupedStream.

join clj

(join ktable other-ktable value-joiner-fn)

Combines the values of the two KTables that share the same key using an inner join.

join-global clj

(join-global kstream global-ktable kv-mapper joiner)

join-windowed clj

(join-windowed kstream other-kstream value-joiner-fn windows)

(join-windowed kstream
               other-kstream
               value-joiner-fn
               windows
               this-topic-config
               other-topic-config)

Combines the values of two streams that share the same key using a windowed inner join.

kafka-streams clj

(kafka-streams builder opts)

Makes a Kafka Streams object.

kgroupedstream* clj

(kgroupedstream* kgroupedstream)

Returns the underlying KGroupedStream object.

kgroupedtable* clj

(kgroupedtable* kgroupedtable)

Returns the underlying KGroupedTable object.

kstream clj

(kstream streams-builder topic-config)

(kstream streams-builder topic-config topic-pattern)

Creates a KStream that will consume messages from the specified topic.

kstream* clj

(kstream* kstream)

Returns the underlying KStream object.

kstreams clj

(kstreams streams-builder topic-configs)

Creates a KStream that will consume messages from the specified topics.

ktable clj

(ktable streams-builder topic-config)

(ktable streams-builder topic-config store-name)

Creates a KTable that will consist of data from the specified topic.

ktable* clj

(ktable* ktable)

Returns the underlying KTable object.

left-join clj

(left-join kstream ktable value-joiner-fn)

(left-join kstream ktable value-joiner-fn this-topic-config other-topic-config)

Creates a KStream from the result of calling value-joiner-fn with each element in the KStream and the value in the KTable with the same key.

left-join-global clj

(left-join-global kstream global-ktable kv-mapper joiner)

left-join-windowed clj

(left-join-windowed kstream other-kstream value-joiner-fn windows)

(left-join-windowed kstream
                    other-kstream
                    value-joiner-fn
                    windows
                    this-topic-config
                    other-topic-config)

Combines the values of two streams that share the same key using a windowed left join.

map clj

(map kstream key-value-mapper-fn)

Creates a KStream that consists of the result of applying key-value-mapper-fn to each key/value pair in the input stream.

map-values clj

(map-values kstream value-mapper-fn)

Creates a KStream that is the result of calling value-mapper-fn on each element of the input stream.

merge clj

(merge kstream other)

outer-join clj

(outer-join ktable other-ktable value-joiner-fn)

Combines the values of two KTables that share the same key using an outer join.

outer-join-windowed clj

(outer-join-windowed kstream other-kstream value-joiner-fn windows)

(outer-join-windowed kstream
                     other-kstream
                     value-joiner-fn
                     windows
                     this-topic-config
                     other-topic-config)

Combines the values of two streams that share the same key using a windowed outer join.

peek clj

(peek kstream peek-fn)

Performs the action defined by peek-fn on each element of the input KStream, returning that stream untransformed.

print! clj

(print! kstream)

Prints the elements of the stream to out.

process! clj

(process! kstream processor-fn state-store-names)

Applies processor-fn to each item in the input stream.

reduce clj

(reduce kgrouped reducer-fn)

(reduce kgrouped reducer-fn subtractor-fn-or-topic-config)

(reduce kgrouped adder-fn subtractor-fn topic-config)

Combines values of a stream by key into a new KTable.

select-key clj

(select-key kstream select-key-value-mapper-fn)

Create a new key from the current key and value.

select-key-value-mapper-fn should be a function that takes a key-value pair, and returns the value of the new key. Here is example multiplies each key by 10:

(fn [[k v]] (* 10 k))

source-topics clj

(source-topics streams-builder)

Gets the names of source topics for the topology.

start clj

(start kafka-streams)

Starts processing.

state clj

(state k-streams)

state->keyword clj

(state->keyword state)

streams-builder clj

(streams-builder)

streams-builder* clj

(streams-builder* streams-builder)

Returns the underlying KStreamBuilder.

suppress clj

(suppress ktable suppressed)

Suppress some updates from this changelog stream

through clj

(through kstream topic-config)

Materializes a stream to a topic, and returns a new KStream that will consume messages from the topic.

to clj

(to kstream topic-config)

Materializes a stream to a topic.

to-kstream clj

(to-kstream ktable)

(to-kstream ktable key-value-mapper-fn)

Converts a KTable to a KStream.

transform clj

(transform kstream transformer-supplier-fn)

(transform kstream transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each key/value in the input stream.

transform-values clj

(transform-values kstream value-transformer-supplier-fn)

(transform-values kstream value-transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each value in the input stream.

window-by-session clj

(window-by-session kgroupedstream window)

Windows the KStream

window-by-time clj

(window-by-time kgroupedstream window)

Windows the KStream

with-state-store clj

(with-state-store streams-builder store-config)

Adds a persistent state store to the topology with the configured name and serdes