Liking cljdoc? Tell your friends :D

sparkplug.config

Functions for working with Spark configuration.

Functions for working with Spark configuration.

app-name

(app-name conf name-str)

Set the Spark application name. Returns updated configuration.

Set the Spark application name. Returns updated configuration.
sourceraw docstring

contains-key?

(contains-key? conf k)

True if the given spark configuration contains the named parameter.

True if the given spark configuration contains the named parameter.
sourceraw docstring

debug-str

(debug-str conf)

Return a string containing a representation of the configuration useful for debugging.

Return a string containing a representation of the configuration useful for
debugging.
sourceraw docstring

get-all

(get-all conf)

Get all configuration parameters as a map.

Get all configuration parameters as a map.
sourceraw docstring

get-param

(get-param conf k)
(get-param conf k not-found)

Get a configuration parameter k in conf. If not set, this throws a NoSuchElementException or returns not-found if provided.

Get a configuration parameter `k` in `conf`. If not set, this throws a
`NoSuchElementException` or returns `not-found` if provided.
sourceraw docstring

jars

(jars conf jars)

Set JAR files to distribute to the cluster. Returns updated configuration.

Set JAR files to distribute to the cluster. Returns updated configuration.
sourceraw docstring

master

(master conf master)

Set the Spark master property. Returns updated configuration.

Set the Spark master property. Returns updated configuration.
sourceraw docstring

merge-params

(merge-params conf params)

Merge the provided parameters into the Spark configuration. Returns updated configuration.

Merge the provided parameters into the Spark configuration. Returns updated
configuration.
sourceraw docstring

set-executor-env

(set-executor-env conf env)
(set-executor-env conf k v)

Set environment variables to be used when launching executors for this application. Accepts a parameter key and value or a map of parameters. Returns an updated configuration.

Set environment variables to be used when launching executors for this
application. Accepts a parameter key and value or a map of parameters.
Returns an updated configuration.
sourceraw docstring

set-param

(set-param conf k v)
(set-param conf k v & kvs)

Set a parameter to a new value in the given Spark configuration. Returns updated configuration.

Set a parameter to a new value in the given Spark configuration. Returns
updated configuration.
sourceraw docstring

set-param-default

(set-param-default conf k v)

Set a parameter to a new value if it is not already set in the config. Returns an updated configuration.

Set a parameter to a new value if it is not already set in the config.
Returns an updated configuration.
sourceraw docstring

spark-conf

(spark-conf)
(spark-conf defaults?)

Construct a new Spark configuration. Optionally accepts a boolean to control whether default configuration is loaded from the system properties.

Construct a new Spark configuration. Optionally accepts a boolean to control
whether default configuration is loaded from the system properties.
sourceraw docstring

spark-home

(spark-home conf home)

Set the Spark home path property. Returns updated configuration.

Set the Spark home path property. Returns updated configuration.
sourceraw docstring

unset-param

(unset-param conf k)
(unset-param conf k & ks)

Unset the given parameters on the config. Returns an updated config.

Unset the given parameters on the config. Returns an updated config.
sourceraw docstring

cljdoc is a website building & hosting documentation for Clojure/Script libraries

× close