hdfs.core — hdfs-clj 0.1.16

absolute-path clj

(absolute-path path & [config])

Returns the absolute path.

buffered-reader clj

(buffered-reader path)

Open path and return a BufferedReader.

buffered-writer clj

(buffered-writer path)

Open path and return a BufferedWriter.

compression-codec clj

(compression-codec path)

Returns the compression codec for path.

configuration clj

(configuration)

Returns the Hadoop configuration.

copy-from-local-file clj

(copy-from-local-file source destination & {:keys [overwrite]})

Copy the local file from source to destination.

copy-matching clj

(copy-matching pattern destination & {:keys [header delete-source overwrite]})

Copy all files matching pattern to the output file destination.

copy-merge clj

(copy-merge source-dir destination & {:keys [header delete-source overwrite]})

Copy all files in source-dir to the output file destination.

copy-to-local-file clj

(copy-to-local-file source destination)

Copy the file from source to destination on the local filesystem.

crc-filename clj

(crc-filename filename)

Returns the filename to the CRC file of filename.

crc-path clj

(crc-path filename)

Returns the path to the CRC file of filename.

delete clj

(delete path & [recursive])

Delete path recursively.

delete-all-fs clj

(delete-all-fs fs paths)

directory? clj

(directory? path)

Returns true if path is a directory, otherwise false.

exists? clj

(exists? path)

Returns true if path exists, otherwise false.

file-size clj

(file-size path)

Returns the file size of path.

file-status clj

(file-status path)

Returns a file status object that represents the path.

file? clj

(file? path)

Returns true if path is a file, otherwise false.

filesystem clj

(filesystem path & [config])

Returns the Hadoop filesystem from path.

glob-paths clj

(glob-paths pattern)

Return a seq of Path objects that match pattern and are not checksum files.

glob-status clj

(glob-status pattern)

Return all the files that match pattern and are not checksum files.

input-stream clj

(input-stream path)

Open path and return a FSDataInputStream.

list-file-status clj

(list-file-status path & [recursively])

List the status of all files in directory.

make-directory clj

(make-directory path)

Make the given path and all non-existent parents into directories.

make-parents clj

(make-parents path & [permissions])

Make the given path and all non-existent parents into directories.

make-path clj

(make-path arg)

(make-path parent child)

(make-path parent child & more)

Returns a org.apache.hadoop.fs.Path, passing each arg to make-path. Multiple-arg versions treat the first argument as parent and subsequent args as children relative to the parent.

output-stream clj

(output-stream path)

Open path and return a FSDataOutputStream.

part-file-seq clj

(part-file-seq directory & [recursively])

Returns a seq of part files in directory

path? clj

(path? arg)

Returns true if arg is a Path, otherwise false.

print-writer clj

(print-writer path)

Open path and return a BufferedWriter.

qualified-path clj

(qualified-path path & [config])

Returns the qualified path.

read-lines clj

(read-lines input)

Read lines from input.

rename clj

(rename source destination & [overwrite])

Renames source to Path destination.

sequence-file-seq clj

(sequence-file-seq path)

Returns the concatenation of the content of all sequence files that match pattern as a lazy seq.

sequence-file-seq* clj

(sequence-file-seq* path)

Returns the content of the sequence file at path as a lazy seq.

sequence-file-writer clj

(sequence-file-writer path key val)

Returns a sequence file writer for key and val classes.

slurp clj

(slurp f & opts)

spit clj

(spit f content & opts)

with-fs-tmp clj macro

(with-fs-tmp [fs-sym & tmp-syms] & body)

Generates unique, temporary path names as subfolders of <root>/cascalog_reserved. <root> by default will be '/tmp', but you can configure it via the JobConf property cascalog.io/tmp-dir-property.

write-lines clj

(write-lines output lines & [transform-fn])

Write lines to output.