ablauf.job.manifold — exoscale/ablauf 0.2.0

An execution engine for warp jobs on manifold. To perform parallel actions with manifold.

Execution is represented as a stream on which results are produced.

The stream is closed when execution is finished. Each execution step is store with the help of a ablauf.job.store/JobStore implementation that needs to be supplied.

This namespace makes no assumption on how to actually perform side-effects, consumers of runner need to extend the dispatch-action multimethod to perform those.

dispatch-action clj multimethod

Dumb action handler, should live in its own namespace and be provided to the runner instead.

Methods should be installed by callers of runner since this namespace does not know what side effects may be performed.

All methods are expected to yield manifold deferred.

fail! clj

(fail! input clock dispatch result)

Push a failure value back on the restarter

redispatcher clj

(redispatcher dispatcher input store id result)

Once dispatchs have been determined by job/restart, dispatch actions with callbacks into the restarter.

restart-transducer clj

(restart-transducer job)

A transducer which yields all intermediate reduced values of job/restart

runner clj

(runner store ast {:keys [action-fn id context buffer runtime] :or {buffer 10}})

Create a stream which listens for input results and figures out next dispatchs to send.

success! clj

(success! input clock dispatch result)

Push a success value back on the restarter