Liking cljdoc? Tell your friends :D

jackdaw.streams.protocols

Kafka streams protocols.

Kafka streams protocols.
raw docstring

IGlobalKTablecljprotocol

global-ktable*clj

(global-ktable* globalktable)

Returns the underlying GlobalKTable

Returns the underlying GlobalKTable
source

IKGroupedBasecljprotocol

Methods shared between IKGroupedTable and IKGroupedStream.

Methods shared between `IKGroupedTable` and `IKGroupedStream`.

aggregateclj

(aggregate kgrouped initializer-fn aggregator-fn)
(aggregate kgrouped initializer-fn aggregator-fn subtractor-fn-or-topic-config)
(aggregate kgrouped
           initializer-fn
           adder-fn
           subtractor-or-merger-fn
           topic-config)

Aggregates values by key into a new KTable.

Aggregates values by key into a new KTable.

countclj

(count kgrouped)
(count kgrouped topic-config)

Counts the number of records by key into a new KTable.

Counts the number of records by key into a new KTable.

reduceclj

(reduce kgrouped reducer-fn)
(reduce kgrouped reducer-fn subtractor-fn-or-topic-config)
(reduce kgrouped adder-fn subtractor-fn topic-config)

Combines values of a stream by key into a new KTable.

Combines values of a stream by key into a new KTable.
sourceraw docstring

IKGroupedStreamcljprotocol

KGroupedStream is an abstraction of a grouped stream.

KGroupedStream is an abstraction of a grouped stream.

kgroupedstream*clj

(kgroupedstream* kgroupedstream)

Returns the underlying KGroupedStream object.

Returns the underlying KGroupedStream object.

windowed-by-sessionclj

(windowed-by-session kgroupedstream window)

windowed-by-timeclj

(windowed-by-time kgroupedstream window)
sourceraw docstring

IKGroupedTablecljprotocol

KGroupedTable is an abstraction of a grouped changelog stream.

KGroupedTable is an abstraction of a grouped changelog stream.

kgroupedtable*clj

(kgroupedtable* kgroupedtable)

Returns the underlying KGroupedTable object.

Returns the underlying KGroupedTable object.
sourceraw docstring

IKStreamcljprotocol

A KStream is an abstraction of a stream of key-value pairs.

A KStream is an abstraction of a stream of key-value pairs.

left-join-globalclj

(left-join-global kstream global-ktable kv-mapper joiner)

transform-valuesclj

(transform-values kstream value-transformer-supplier-fn)
(transform-values kstream value-transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each value in the input stream.

Creates a KStream that consists of the results of applying the transformer
to each value in the input stream.

branchclj

(branch kstream predicate-fns)

Returns a list of KStreams, one for each of the predicate-fns provided.

Returns a list of KStreams, one for each of the `predicate-fns`
provided.

flat-mapclj

(flat-map kstream key-value-mapper-fn)

Creates a KStream that will consist of the concatenation of messages returned by calling key-value-mapper-fn on each key/value pair in the input stream.

Creates a KStream that will consist of the concatenation of messages
returned by calling `key-value-mapper-fn` on each key/value pair in the
input stream.

mapclj

(map kstream key-value-mapper-fn)

Creates a KStream that consists of the result of applying key-value-mapper-fn to each key/value pair in the input stream.

Creates a KStream that consists of the result of applying
`key-value-mapper-fn` to each key/value pair in the input stream.

print!clj

(print! kstream)

Prints the elements of the stream to out.

Prints the elements of the stream to *out*.

flat-map-valuesclj

(flat-map-values kstream value-mapper-fn)

Creates a KStream that will consist of the concatenation of the values returned by calling value-mapper-fn on each value in the input stream.

Creates a KStream that will consist of the concatenation of the values
returned by calling `value-mapper-fn` on each value in the input stream.

process!clj

(process! kstream processor-fn state-store-names)

Applies processor-fn to each item in the input stream.

Applies `processor-fn` to each item in the input stream.

to!clj

(to! kstream topic-config)

Materializes a stream to a topic.

Materializes a stream to a topic.

group-by-keyclj

(group-by-key kstream)
(group-by-key kstream topic-config)

Groups records with the same key into a KGroupedStream.

Groups records with the same key into a KGroupedStream.

flat-transform-valuesclj

(flat-transform-values kstream value-transformer-supplier-fn)
(flat-transform-values kstream value-transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each key/value in the input stream via flatTransformValues.

Creates a KStream that consists of the results of applying the transformer
to each key/value in the input stream via flatTransformValues.

transformclj

(transform kstream transformer-supplier-fn)
(transform kstream transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each key/value in the input stream.

Creates a KStream that consists of the results of applying the transformer
to each key/value in the input stream.

throughclj

(through kstream topic-config)

Materializes a stream to a topic, and returns a new KStream that will consume messages from the topic. Messages in the new topic will be partitioned based on the output of the optional partition function that represents StreamPartitioner class

Materializes a stream to a topic, and returns a new KStream that will
consume messages from the topic. Messages in the new topic will be partitioned
based on the output of the optional partition function that represents StreamPartitioner class

for-each!clj

(for-each! kstream foreach-fn)

Performs an action on each element of KStream.

Performs an action on each element of KStream.

outer-join-windowedclj

(outer-join-windowed kstream other-kstream value-joiner-fn windows)
(outer-join-windowed kstream
                     other-kstream
                     value-joiner-fn
                     windows
                     this-topic-config
                     other-topic-config)

Combines the values of two streams that share the same key using a windowed outer join.

Combines the values of two streams that share the same key using a
windowed outer join.

left-join-windowedclj

(left-join-windowed kstream other-kstream value-joiner-fn windows)
(left-join-windowed kstream
                    other-kstream
                    value-joiner-fn
                    windows
                    this-topic-config
                    other-topic-config)

Combines the values of two streams that share the same key using a windowed left join.

Combines the values of two streams that share the same key using a
windowed left join.

kstream*clj

(kstream* kstream)

Returns the underlying KStream object.

Returns the underlying KStream object.

join-globalclj

(join-global kstream global-ktable kv-mapper joiner)

flat-transformclj

(flat-transform kstream transformer-supplier-fn)
(flat-transform kstream transformer-supplier-fn state-store-names)

Creates a KStream that consists of the results of applying the transformer to each key/value in the input stream via flatTransform.

Creates a KStream that consists of the results of applying the transformer
to each key/value in the input stream via flatTransform.

select-keyclj

(select-key kstream select-key-value-mapper-fn)

Create a new key from the current key and value.

select-key-value-mapper-fn should be a function that takes a key-value pair, and returns the value of the new key. Here is example multiplies each key by 10:

(fn [[k v]] (* 10 k))

Create a new key from the current key and value.

`select-key-value-mapper-fn` should be a function that takes a key-value
pair, and returns the value of the new key. Here is example multiplies each
key by 10:

```(fn [[k v]] (* 10 k))```

mergeclj

(merge kstream other)

Creates a KStream that has the records from both streams.

Creates a KStream that has the records from both streams.

join-windowedclj

(join-windowed kstream other-kstream value-joiner-fn windows)
(join-windowed kstream
               other-kstream
               value-joiner-fn
               windows
               this-topic-config
               other-topic-config)

Combines the values of two streams that share the same key using a windowed inner join.

Combines the values of two streams that share the same key using a
windowed inner join.
sourceraw docstring

IKStreamBasecljprotocol

Methods common to KStream and KTable.

Methods common to KStream and KTable.

filterclj

(filter kstream-or-ktable predicate-fn)

Creates a KStream that consists of all elements that satisfy a predicate.

Creates a KStream that consists of all elements that satisfy a
predicate.

filter-notclj

(filter-not kstream-or-ktable predicate-fn)

Creates a KStream that consists of all elements that do not satisfy a predicate.

Creates a KStream that consists of all elements that do not satisfy a
predicate.

group-byclj

(group-by ktable-or-ktable key-value-mapper-fn)
(group-by ktable-or-ktable key-value-mapper-fn topic-config)

Groups the records of this KStream/KTable using the key-value-mapper-fn.

Groups the records of this KStream/KTable using the key-value-mapper-fn.

left-joinclj

(left-join kstream-or-ktable ktable value-joiner-fn)
(left-join kstream-or-ktable
           ktable
           value-joiner-fn
           this-topic-config
           other-topic-config)

Creates a KStream from the result of calling value-joiner-fn with each element in the KStream and the value in the KTable with the same key.

Creates a KStream from the result of calling `value-joiner-fn` with
each element in the KStream and the value in the KTable with the same
key.

map-valuesclj

(map-values kstream-or-ktable value-mapper-fn)

Creates a KStream that is the result of calling value-mapper-fn on each element of the input stream.

Creates a KStream that is the result of calling `value-mapper-fn` on each
element of the input stream.

peekclj

(peek kstream-or-ktable peek-fn)

Performs peek-fn on each element of the input stream.

Performs `peek-fn` on each element of the input stream.

write-as-text!clj

(write-as-text! kstream-or-ktable file-path)
(write-as-text! kstream-or-ktable file-path topic-config)

Writes the elements of a stream to a file at the given path.

Writes the elements of a stream to a file at the given path.
sourceraw docstring

IKTablecljprotocol

A Ktable is an abstraction of a changlog stream.

A Ktable is an abstraction of a changlog stream.

joinclj

(join ktable other-ktable value-joiner-fn)

Combines the values of the two KTables that share the same key using an inner join.

Combines the values of the two KTables that share the same key using an
inner join.

ktable*clj

(ktable* ktable)

Returns the underlying KTable object.

Returns the underlying KTable object.

outer-joinclj

(outer-join ktable other-ktable value-joiner-fn)

Combines the values of two KTables that share the same key using an outer join.

Combines the values of two KTables that share the same key using an outer
join.

suppressclj

(suppress ktable {:keys [max-records max-bytes until-time-limit-ms]})

Suppress some updates from this changelog stream. You can either specify max-records or max-bytes. If an empty map is passed, the suppress will be unbounded. If until-time-limit-ms is set, this will override the TimeWindow interval. Note that when relying on the configured TimeWindow the default grace period is 24h - window-size.

Suppress some updates from this changelog stream.
You can either specify `max-records` or `max-bytes`. If an empty map is
passed, the suppress will be unbounded. If `until-time-limit-ms` is set,
this will override the `TimeWindow` interval. Note that when relying on the
configured `TimeWindow` the default `grace` period is `24h - window-size`.

to-kstreamclj

(to-kstream ktable)
(to-kstream ktable key-value-mapper-fn)

Converts a KTable to a KStream.

Converts a KTable to a KStream.
sourceraw docstring

ISessionWindowedKStreamcljprotocol

ISessionWindowedKStream is an abstraction of a session windowed stream.

ISessionWindowedKStream is an abstraction of a session windowed stream.

session-windowed-kstream*clj

(session-windowed-kstream* ksession-windowed-kstream)

Returns the underlying SessionWindowedKStream object.

Returns the underlying SessionWindowedKStream object.
sourceraw docstring

IStreamsBuildercljprotocol

global-ktableclj

(global-ktable topology-builder topic-config)

Creates a GlobalKTable that will consist of data from the specified topic.

Creates a GlobalKTable that will consist of data from the specified
topic.

kstreamclj

(kstream topology-builder topic-config)
(kstream topology-builder topic-config topic-pattern)

Creates a KStream that will consume messages from the specified topic.

Creates a KStream that will consume messages from the specified topic.

kstreamsclj

(kstreams topology-builder topic-configs)

Creates a KStream that will consume messages from the specified topics.

Creates a KStream that will consume messages from the specified topics.

ktableclj

(ktable topology-builder topic-config)
(ktable topology-builder topic-config store-name)

Creates a KTable that will consist of data from the specified topic.

Creates a KTable that will consist of data from the specified topic.

source-topicsclj

(source-topics topology-builder)

Gets the names of source topics for the topology.

Gets the names of source topics for the topology.

streams-builder*clj

(streams-builder* streams-builder)

Returns the underlying KStreamBuilder.

Returns the underlying KStreamBuilder.

with-state-storeclj

(with-state-store topology-builder store-config)

Adds a persistent state store to the topology with the configured name and serdes.

(with-state-store builder {:store-name ... :key-serde ... :value-serde ...}

Adds a persistent state store to the topology with the configured name
and serdes.

```(with-state-store builder {:store-name ... :key-serde ... :value-serde ...}```
source

ITimeWindowedKStreamcljprotocol

ITimeWindowedKStream is an abstraction of a time windowed stream.

ITimeWindowedKStream is an abstraction of a time windowed stream.

time-windowed-kstream*clj

(time-windowed-kstream* ktime-windowed-kstream)

Returns the underlying TimeWindowedKStream object.

Returns the underlying TimeWindowedKStream object.
sourceraw docstring

cljdoc is a website building & hosting documentation for Clojure/Script libraries

× close