Functions for working with Accumulator objects which can aggregate values across executors.
Functions for working with Accumulator objects which can aggregate values across executors.
Functions for working with Spark configuration.
Functions for working with Spark configuration.
Functions for working with and creating Spark contexts.
Functions for working with and creating Spark contexts.
This namespace provides the main API for writing Spark tasks.
Most operations in this namespace place the RDD last in the argument list,
just like Clojure collection functions. This lets you compose them using the
thread-last macro (->>
), making it simple to migrate existing Clojure
code.
This namespace provides the main API for writing Spark tasks. Most operations in this namespace place the RDD last in the argument list, just like Clojure collection functions. This lets you compose them using the thread-last macro (`->>`), making it simple to migrate existing Clojure code.
This namespace generates function classes for various kinds of interop with Spark and Scala.
This namespace generates function classes for various kinds of interop with Spark and Scala.
Functions for managing object serialization with Kryo.
To configure a new Kryo instance, this class looks up all resources in
directories named sparkplug/kryo/registry/
on the classpath. The files are
read in sorted order, one line at a time. Each line should be tab-separated
and begin with the desired action:
require {{namespace}}
Require a namespace to load code or for other side effects.register {{class}}
Register the named class with default serialization. The class name may be
suffixed with []
pairs to indicate array class types.register {{class}} {{serializer}}
Register the named class with the given serializer. The serializer may
either be the name of a class to instantiate with the default constructor,
or a qualified function var be resolved and called with no arguments to
return a Serializer
instance.configure {{config-fn}}
Resolve the named function and call it on the Kryo instance to directly
configure it.Blank lines or lines beginning with a hash (#) are ignored.
Functions for managing object serialization with Kryo. To configure a new Kryo instance, this class looks up all resources in directories named `sparkplug/kryo/registry/` on the classpath. The files are read in sorted order, one line at a time. Each line should be tab-separated and begin with the desired action: - `require {{namespace}}` Require a namespace to load code or for other side effects. - `register {{class}}` Register the named class with default serialization. The class name may be suffixed with `[]` pairs to indicate array class types. - `register {{class}} {{serializer}}` Register the named class with the given serializer. The serializer may either be the name of a class to instantiate with the default constructor, or a qualified function var be resolved and called with no arguments to return a `Serializer` instance. - `configure {{config-fn}}` Resolve the named function and call it on the Kryo instance to directly configure it. Blank lines or lines beginning with a hash (#) are ignored.
This namespace provides the main API for writing Spark tasks.
Most operations in this namespace place the RDD last in the argument list,
just like Clojure collection functions. This lets you compose them using the
thread-last macro (->>
), making it simple to migrate existing Clojure
code.
This namespace provides the main API for writing Spark tasks. Most operations in this namespace place the RDD last in the argument list, just like Clojure collection functions. This lets you compose them using the thread-last macro (`->>`), making it simple to migrate existing Clojure code.
Commonly used utilities for interop with Scala objects.
Commonly used utilities for interop with Scala objects.
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close