Liking cljdoc? Tell your friends :D

sparkplug.accumulator

Functions for working with Accumulator objects which can aggregate values across executors.

Functions for working with Accumulator objects which can aggregate values
across executors.
raw docstring

sparkplug.core

This namespace provides the main API for writing Spark tasks.

Most operations in this namespace place the RDD last in the argument list, just like Clojure collection functions. This lets you compose them using the thread-last macro (->>), making it simple to migrate existing Clojure code.

This namespace provides the main API for writing Spark tasks.

Most operations in this namespace place the RDD last in the argument list,
just like Clojure collection functions. This lets you compose them using the
thread-last macro (`->>`), making it simple to migrate existing Clojure
code.
raw docstring

sparkplug.function

This namespace generates function classes for various kinds of interop with Spark and Scala.

This namespace generates function classes for various kinds of interop with
Spark and Scala.
raw docstring

sparkplug.kryo

Functions for managing object serialization with Kryo.

To configure a new Kryo instance, this class looks up all resources in directories named sparkplug/kryo/registry/ on the classpath. The files are read in sorted order, one line at a time. Each line should be tab-separated and begin with the desired action:

  • require {{namespace}} Require a namespace to load code or for other side effects.
  • register {{class}} Register the named class with default serialization. The class name may be suffixed with [] pairs to indicate array class types.
  • register {{class}} {{serializer}} Register the named class with the given serializer. The serializer may either be the name of a class to instantiate with the default constructor, or a qualified function var be resolved and called with no arguments to return a Serializer instance.
  • configure {{config-fn}} Resolve the named function and call it on the Kryo instance to directly configure it.

Blank lines or lines beginning with a hash (#) are ignored.

Functions for managing object serialization with Kryo.

To configure a new Kryo instance, this class looks up all resources in
directories named `sparkplug/kryo/registry/` on the classpath. The files are
read in sorted order, one line at a time. Each line should be tab-separated
and begin with the desired action:

- `require        {{namespace}}`
  Require a namespace to load code or for other side effects.
- `register       {{class}}`
  Register the named class with default serialization. The class name may be
  suffixed with `[]` pairs to indicate array class types.
- `register       {{class}}     {{serializer}}`
  Register the named class with the given serializer. The serializer may
  either be the name of a class to instantiate with the default constructor,
  or a qualified function var be resolved and called with no arguments to
  return a `Serializer` instance.
- `configure      {{config-fn}}`
  Resolve the named function and call it on the Kryo instance to directly
  configure it.

Blank lines or lines beginning with a hash (#) are ignored.
raw docstring

sparkplug.rdd

This namespace provides the main API for writing Spark tasks.

Most operations in this namespace place the RDD last in the argument list, just like Clojure collection functions. This lets you compose them using the thread-last macro (->>), making it simple to migrate existing Clojure code.

This namespace provides the main API for writing Spark tasks.

Most operations in this namespace place the RDD last in the argument list,
just like Clojure collection functions. This lets you compose them using the
thread-last macro (`->>`), making it simple to migrate existing Clojure
code.
raw docstring

sparkplug.scala

Commonly used utilities for interop with Scala objects.

Commonly used utilities for interop with Scala objects.
raw docstring

cljdoc is a website building & hosting documentation for Clojure/Script libraries

× close