clj-headlights.test-helpers — com.zendesk/clj-headlights 0.1.4

Tools to test dataflow jobs

assign-dummy-key clj

(assign-dummy-key val)

cat-files-like clj

(cat-files-like tempfile)

create-pcoll clj

(create-pcoll elems)

(create-pcoll pipeline elems)

create-pcoll-KVs clj

(create-pcoll-KVs elems)

(create-pcoll-KVs pipeline elems)

create-test-pipeline clj

(create-test-pipeline)

get-data-from-sinks clj

(get-data-from-sinks sinks)

pcoll-contains clj macro

(pcoll-contains pcoll expected)

pcoll-counter clj

pcoll-is clj macro

(pcoll-is expected-pcoll result-pcoll)

pcoll-matches clj

(pcoll-matches expected-f pcoll)

pcoll-results-match clj

(pcoll-results-match func)

Inputs: [func :- IFn] Returns: IFn

Checker that runs a pcoll's pipeline, gather its output, and passes it to func. If func throws or returns false, the test failed.

Example: see pcoll-contains

pcoll-to-data clj

(pcoll-to-data pcoll)

pipeline-to-data clj

(pipeline-to-data pcolls)

prn-cogbkresult clj

(prn-cogbkresult [id co-gbkresult])

sink-counter clj

sink-pcoll clj

(sink-pcoll pcoll)

sink-pcolls clj

(sink-pcolls pcolls)

try-read-file clj

(try-read-file file-name)