fileape.parquet.write-support — fileape 2.0.3

Implement java write support for parquet the different types and cases that can be written is done via multimethods while the actual WriterSupport is reified

as-float clj

(as-float val)

as-number clj

(as-number val)

asbinary clj

(asbinary v)

BYTE-ARRAY-CLASS clj

check-is-map clj

(check-is-map v)

If v is not null then check that v is an instanceof java.util.Map, if not an exception is thrown

date->int-seconds clj

(date->int-seconds date)

Convert a date to seconds and return a casted int

end-field clj

(end-field rconsumer field-name i)

end-group clj

(end-group rconsumer)

get-map-schemas clj

(get-map-schemas schema)

The schema should be a valid hive map and have the format #<GroupType optional group [map-field-name] (MAP) { repeated group map (MAP_KEY_VALUE) { required binary key; optional binary value; } }

java-write-support clj

(java-write-support schema meta)

Returns an instance of WriteSupport that will correctly serialise standard java types compatible with Hive.

Note: Repeated must have List as the original Type and will be a list type groups must be a Map type

start-field clj

(start-field rconsumer field-name i)

start-group clj

(start-group rconsumer)

with-default clj macro

(with-default default & body)

write-extended-val clj multimethod

Any object other than a Java primitive, the dispatch is based on the Type::originalType

write-key-value clj

(write-key-value rconsumer schema k v)

Write a hive map compatible data structure from the schema { repeated group map (MAP_KEY_VALUE) { required binary key; optional binary value; } } Note only the key value parts are written, the group and field for map needs to be created before and ended after this function is called for all key values

write-message-fields clj

(write-message-fields rconsumer schema val)

Write the fields of a top level message

write-primitive-val clj

(write-primitive-val rconsumer schema val)

write-val clj

(write-val rconsumer schema val)

Write a primitive or extend (List Map) value