zero-one.geni.interop — zero.one/geni 0.3.0

->clojure clj

(->clojure value)

Converts a value that Spark hands back, such as a Row, a Scala collection or an MLlib vector, into Clojure data. A Clojure map, vector or set keeps its type, with its contents converted, and a Boolean comes back as true or false itself, which a Boolean that Java deserialised isn't.

->dense-vector clj

(->dense-vector values)

->java clj

(->java cls value)

Converts a Clojure value into an argument for a Java setter that takes cls: numbers to the right width, collections to arrays, strings to enums.

->java-list clj

(->java-list coll)

->scala-function0 clj

(->scala-function0 f)

->scala-function1 clj

(->scala-function1 f)

->scala-function2 clj

(->scala-function2 f)

->scala-function3 clj

(->scala-function3 f)

->scala-seq clj

(->scala-seq coll)

An immutable Scala List, which Spark's methods take as a Seq on both Scala 2.12 and 2.13.

->scala-tuple2 clj

(->scala-tuple2 coll)

->spark-row clj

(->spark-row x)

->sparse-vector clj

(->sparse-vector size indices values)

array? clj

(array? value)

convert-keywords clj

(convert-keywords value)

dense clj

(dense & values)

Params: (firstValue: Double, otherValues: Double*)

Result: Vector

Creates a dense vector from its values.

Source: https://spark.apache.org/docs/3.0.1/api/scala/org/apache/spark/ml/linalg/Vectors$.html

Timestamp: 2020-10-19T01:56:35.334Z

dense-matrix? clj

(dense-matrix? value)

dense-vector? clj

(dense-vector? value)

fields-map clj

(fields-map cls)

get-field clj

(get-field instance field-keyword)

instantiate clj

(instantiate cls params)

(instantiate cls defaults params)

Creates an instance of cls, sets params through its setters (e.g. {:input-col "text"} through setInputCol), and returns the instance. A key in params that has no setter throws, with the class's params in the message. The keys in defaults, which are Geni's own, are set when the class has a setter for them and skipped when it doesn't, since a default can be missing from one Spark version.

iterable? clj

(iterable? value)

matrix->seqs clj

(matrix->seqs matrix)

method-keyword clj

(method-keyword method)

mllib-class clj

(mllib-class class-name)

One of MLlib's classes, such as org.apache.spark.ml.linalg.DenseVector. They come with spark-mllib, which is classic Spark only, so a Spark Connect client doesn't have them, and Geni looks them up when it needs them.

optional->nillable clj

(optional->nillable value)

row clj

(row & values)

Params: (values: Seq[Any])

Result: Row

Source: https://spark.apache.org/docs/3.0.1/api/scala/org/apache/spark/sql/Row$.html

Timestamp: 2020-10-19T01:56:24.277Z

scala-map->map clj

(scala-map->map m)

scala-map? clj

(scala-map? value)

scala-seq->vec clj

(scala-seq->vec scala-seq)

scala-seq? clj

(scala-seq? value)

scala-tuple->vec clj

(scala-tuple->vec p)

scala-tuple2? clj

(scala-tuple2? value)

scala-tuple3? clj

(scala-tuple3? value)

set-value clj

(set-value method instance value)

setter-type clj

(setter-type method)

setter? clj

(setter? method)

setters-map clj

(setters-map cls)

The class's setters by param keyword, each a vector of the methods of that name, which can be overloads.

spark-conf->map clj

(spark-conf->map conf)

spark-row->map clj

(spark-row->map row)

spark-row? clj

(spark-row? value)

sparse clj

Params: (size: Int, indices: Array[Int], values: Array[Double])

Result: Vector

Creates a sparse vector providing its index array and value array.

vector size.

index array, must be strictly increasing.

value array, must have the same length as indices.

Source: https://spark.apache.org/docs/3.0.1/api/scala/org/apache/spark/ml/linalg/Vectors$.html

Timestamp: 2020-10-19T01:56:35.350Z

sparse-vector->seq clj

(sparse-vector->seq spark-sparse-vector)

sparse-vector? clj

(sparse-vector? value)

vector->seq clj

(vector->seq spark-vector)

with-scala-out-str clj macro

(with-scala-out-str & body)

zero-arity? clj

(zero-arity? method)