(apply-transform pcoll
transform
schema
{:keys [coder coll-name side-outputs checkpoint] :as options})A modified version of datasplash.core/apply-transform that will save intermediate input
A modified version of `datasplash.core/apply-transform` that will save intermediate input
(save! f names dir)Calls f, saving in/out of every transform in names to dir.
f should run some local test pipeline. It should be blocking, ie
call ds/wait-pipeline-result.
names can be a collection of transform names, or it can be :all
in which case every transform with a keyword name will be saved.
(some internal transforms can't be saved, and these have string names,
so as a workaround we filter out those that don't have a keyword name).
dir will be tilde expanded for convenience.
Note : it might take a while and eat your ram/cpu.
Calls `f`, saving in/out of every transform in `names` to `dir`. `f` should run some local test pipeline. It should be blocking, ie call `ds/wait-pipeline-result`. `names` can be a collection of transform names, or it can be `:all` in which case every transform with a keyword name will be saved. (some internal transforms can't be saved, and these have string names, so as a workaround we filter out those that don't have a keyword name). `dir` will be tilde expanded for convenience. Note : it might take a while and eat your ram/cpu.
cljdoc builds & hosts documentation for Clojure/Script libraries
| Ctrl+k | Jump to recent docs |
| ← | Move to previous article |
| → | Move to next article |
| Ctrl+/ | Jump to the search field |