tech.ml.dataset.column — techascent/tech.ml.dataset 2.11

clone clj

(clone col)

Clone this column not changing anything.

column-name clj

(column-name col)

correlation clj

(correlation lhs rhs correlation-type)

Correlation coefficient for given 2 columns. Available correlation types are: :pearson :spearman :kendall

Returns floating point number between [-1 1]

extend-column-with-empty clj

(extend-column-with-empty column n-empty)

is-column? clj

(is-column? item)

Return true if this item is a column.

is-missing? clj

(is-missing? col idx)

Return true if this index is missing.

merge-metadata clj

(merge-metadata col data-map)

Merge metadata in column with this map. Beware this could change the name of the column.

metadata clj

(metadata col)

Return the metadata map for this column. Metadata must contain :name :datatype :size. Categorical columns must have :categorical? true and the inference target should have :target? true.

missing clj

(missing col)

Indexes of missing values. Both iterable and reader.

new-column clj

(new-column name data)

(new-column name data metadata)

(new-column name data metadata missing)

parse-column clj

(parse-column datatype col)

(parse-column datatype options col)

parse a text or a str column, returning a new column with the same name but with a different datatype. This method is single-threaded.

parser-fn-or-kwd is nil by default and can the keyword :relaxed? or a function that must return one of parsed-value, :tech.ml.dataset.parse/missing in which case a missing value will be added or :tech.ml.dataset.parse/parse-failure in which case the a missing index will be added and the string value will be recorded in the metadata's :unparsed-data, :unparsed-indexes entries.

prepend-column-with-empty clj

(prepend-column-with-empty column n-empty)

select clj

(select col idx-seq)

Return a new column with the subset of indexes

set-metadata clj

(set-metadata col data-map)

Set the metadata on the column returning a new column. Beware this could change the name.

set-missing clj

(set-missing col idx-seq)

Set the missing indexes for a column. This doesn't change any values in the underlying data store.

set-name clj

(set-name col name)

Return a new column.

stats clj

(stats col stats-set)

Return a map of stats. Stats set is a set of the desired stats in keyword form. Guaranteed support across implementations for :mean :variance :median :skew. Implementations should check their metadata before doing calculations.

string-table-keyset clj

(string-table-keyset col)

Get the string table for this column. Returns nil if this isn't a string column. This doesn't necessarily tell you the unique set of the column unless you have just parsed a file. It is, when non-nil, a strict superset of the strings in the columns.

supported-stats clj

(supported-stats col)

List of available stats for the column

to-double-array clj

(to-double-array col & [error-on-missing?])

Convert to a java primitive array of a given datatype. For strings, an implicit string->double mapping is expected. For booleans, true=1 false=0. Finally, any missing values should be indicated by a NaN of the expected type.

unique clj

(unique col)

Set of all unique values