Liking cljdoc? Tell your friends :D
Clojure only.
zero-one.geni.spark
create-spark-sessionclj
(create-spark-session
{:keys [app-name master configs log-level checkpoint-dir]
:or {app-name "Geni App" master "local[*]" configs {} log-level "WARN"}})The entry point to programming Spark with the Dataset and DataFrame API.
The entry point to programming Spark with the Dataset and DataFrame API.
spark-confclj
(spark-conf spark-session)Params:
Result: SparkConf
Return a copy of this JavaSparkContext's configuration. The configuration cannot be changed at runtime.
Source: https://spark.apache.org/docs/3.0.1/api/scala/org/apache/spark/api/java/JavaSparkContext.html
Timestamp: 2020-10-19T01:56:49.511Z
Params: Result: SparkConf Return a copy of this JavaSparkContext's configuration. The configuration cannot be changed at runtime. Source: https://spark.apache.org/docs/3.0.1/api/scala/org/apache/spark/api/java/JavaSparkContext.html Timestamp: 2020-10-19T01:56:49.511Z
sqlclj
(sql spark sql-text)Executes a SQL query using Spark, returning the result as a DataFrame.
The dialect that is used for SQL parsing can be configured with 'spark.sql.dialect'.
(g/sql spark "SELECT * FROM my_table")
Executes a SQL query using Spark, returning the result as a `DataFrame`. The dialect that is used for SQL parsing can be configured with 'spark.sql.dialect'. ```clojure (g/sql spark "SELECT * FROM my_table") ```
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close