(add-to-batch engine it)
Adds item to batch, adds batch to queue if max-items was reached.
Adds item to batch, adds batch to queue if max-items was reached.
(finished? engine)
(force-enqueue engine)
Forces a batch to queue if queue is empty and the runner state allows for more tasks
Forces a batch to queue if queue is empty and the runner state allows for more tasks
(has-capacity? engine)
(init-engine engine params)
(run!! {:keys [params get-items-fn items-in-runner items-in-process parser]
:as engine}
paging-states)
(run-from-queue! {:keys [async-fn ch-result] :as engine})
Enqueues a batch with the runner if there is one in the queue and the runner has capacity. Returns new engine state.
Enqueues a batch with the runner if there is one in the queue and the runner has capacity. Returns new engine state.
(swap-xf! atom* f)
A transducer that runs f on atom* for each item seen.
A transducer that runs f on atom* for each item seen.
(update-existing-ps {:keys [parser]} result page-states)
Updates an existing pagestate map with results.
Updates an existing pagestate map with results.
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close