Liking cljdoc? Tell your friends :D
pegasus.cache
A simple cache using LMDB
A simple cache using LMDB
pegasus.defaults
Contains default components
Contains default components
pegasus.dsl
DSL for easy extractors and stuff
DSL for easy extractors and stuff
pegasus.process
Two major crawler bits:
- the pipeline - a crawl task from URL to saving a payload is a pipeline
- the pipeline components - each operation in the pipeline - downloading the URL, extracting links, updating crawler state and so on.
This namespace contains defintions and examples.
Two major crawler bits: - the pipeline - a crawl task from URL to saving a payload is a pipeline - the pipeline components - each operation in the pipeline - downloading the URL, extracting links, updating crawler state and so on. This namespace contains defintions and examples.
pegasus.queue
Enqueue and dequeue operations
Enqueue and dequeue operations
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close