cascalog.more-taps — cascalog/cascalog-more-taps 3.0.0

hfs-delimited clj

(hfs-delimited path & opts)

Creates a tap on HDFS using Cascading's TextDelimited scheme. Different filesystems can be selected by using different prefixes for path.

Supports TextDelimited keyword option for :outfields, :classes, :skip-header?, :delimiter, :write-header?, :strict?, safe?, and :quote.

Also supports: :compression - one of :enable, :disable or :default

See cascalog.cascading.tap/hfs-tap for more keyword arguments.

See http://www.cascading.org/javadoc/cascading/tap/Hfs.html and http://www.cascading.org/javadoc/cascading/scheme/TextDelimited.html

hfs-wholefile clj

(hfs-wholefile path & opts)

Subquery to return distinct files in the supplied directory. Files will be returned as 2-tuples, formatted as <filename, file> The filename is a text object, while the entire, unchopped file is encoded as a Hadoop BytesWritable object.

hfs-wrtseqfile clj

(hfs-wrtseqfile path key-type value-type & opts)

Creates a tap on HDFS using sequence file format. Different filesystems can be selected by using different prefixes for path.

Supports keyword option for :outfields. See cascalog.tap/hfs-tap for more keyword arguments.

See http://www.cascading.org/javadoc/cascading/tap/Hfs.html and http://www.cascading.org/javadoc/cascading/scheme/SequenceFile.html

lfs-delimited clj

(lfs-delimited path & opts)

Creates a tap on the local filesystem using Cascading's TextDelimited scheme. Different filesystems can be selected by using different prefixes for path.

Supports TextDelimited keyword option for :outfields, :classes, :compress?, :skip-header?, :delimiter, :write-header?, :strict?, safe?, and :quote.

See cascalog.cascading.tap/hfs-tap for more keyword arguments.

See http://www.cascading.org/javadoc/cascading/tap/Hfs.html and http://www.cascading.org/javadoc/cascading/scheme/TextDelimited.html

lfs-wrtseqfile clj

(lfs-wrtseqfile path key-type value-type & opts)

Creates a tap on local file system using sequence file format. Different filesystems can be selected by using different prefixes for path.

Supports keyword option for :outfields. See cascalog.tap/hfs-tap for more keyword arguments.

See http://www.cascading.org/javadoc/cascading/tap/Hfs.html and http://www.cascading.org/javadoc/cascading/scheme/SequenceFile.html

writable-sequence-file clj

(writable-sequence-file field-names key-type value-type)