pegasus.queue — cc.artifice/pegasus 0.7.2

Enqueue and dequeue operations

build-queue-config clj

(build-queue-config config)

enqueue-pipeline clj

(enqueue-pipeline obj config)

A pipeline component that consumes urls from the supplied object, enqueues them and continues.

enqueue-robots clj

(enqueue-robots a-url q visited-hosts-cache)

enqueue-url clj

(enqueue-url url config)

global-to-visit clj

(global-to-visit q)

How many items are enqueued?

handle-robots-url clj

(handle-robots-url url config)

setup-queue-worker clj

(setup-queue-worker q q-name config)