Liking cljdoc? Tell your friends :D

sparkplug.config

Functions for working with Spark configuration.

Functions for working with Spark configuration.

app-nameclj

(app-name conf name-str)

Set the Spark application name. Returns updated configuration.

Set the Spark application name. Returns updated configuration.
raw docstring

contains-key?clj

(contains-key? conf k)

True if the given spark configuration contains the named parameter.

True if the given spark configuration contains the named parameter.
raw docstring

debug-strclj

(debug-str conf)

Return a string containing a representation of the configuration useful for debugging.

Return a string containing a representation of the configuration useful for
debugging.
raw docstring

get-allclj

(get-all conf)

Get all configuration parameters as a map.

Get all configuration parameters as a map.
raw docstring

get-paramclj

(get-param conf k)
(get-param conf k not-found)

Get a configuration parameter k in conf. If not set, this throws a NoSuchElementException or returns not-found if provided.

Get a configuration parameter `k` in `conf`. If not set, this throws a
`NoSuchElementException` or returns `not-found` if provided.
raw docstring

jarsclj

(jars conf jars)

Set JAR files to distribute to the cluster. Returns updated configuration.

Set JAR files to distribute to the cluster. Returns updated configuration.
raw docstring

masterclj

(master conf master)

Set the Spark master property. Returns updated configuration.

Set the Spark master property. Returns updated configuration.
raw docstring

merge-paramsclj

(merge-params conf params)

Merge the provided parameters into the Spark configuration. Returns updated configuration.

Merge the provided parameters into the Spark configuration. Returns updated
configuration.
raw docstring

set-executor-envclj

(set-executor-env conf env)
(set-executor-env conf k v)

Set environment variables to be used when launching executors for this application. Accepts a parameter key and value or a map of parameters. Returns an updated configuration.

Set environment variables to be used when launching executors for this
application. Accepts a parameter key and value or a map of parameters.
Returns an updated configuration.
raw docstring

set-paramclj

(set-param conf k v)
(set-param conf k v & kvs)

Set a parameter to a new value in the given Spark configuration. Returns updated configuration.

Set a parameter to a new value in the given Spark configuration. Returns
updated configuration.
raw docstring

set-param-defaultclj

(set-param-default conf k v)

Set a parameter to a new value if it is not already set in the config. Returns an updated configuration.

Set a parameter to a new value if it is not already set in the config.
Returns an updated configuration.
raw docstring

spark-confclj

(spark-conf)
(spark-conf defaults?)

Construct a new Spark configuration. Optionally accepts a boolean to control whether default configuration is loaded from the system properties.

Construct a new Spark configuration. Optionally accepts a boolean to control
whether default configuration is loaded from the system properties.
raw docstring

spark-homeclj

(spark-home conf home)

Set the Spark home path property. Returns updated configuration.

Set the Spark home path property. Returns updated configuration.
raw docstring

unset-paramclj

(unset-param conf k)
(unset-param conf k & ks)

Unset the given parameters on the config. Returns an updated config.

Unset the given parameters on the config. Returns an updated config.
raw docstring

cljdoc is a website building & hosting documentation for Clojure/Script libraries

× close