Liking cljdoc? Tell your friends :D

pegasus.cache

A simple cache using LMDB

A simple cache using LMDB
raw docstring

pegasus.dsl

DSL for easy extractors and stuff

DSL for easy extractors and stuff
raw docstring

pegasus.process

Two major crawler bits:

  • the pipeline - a crawl task from URL to saving a payload is a pipeline
  • the pipeline components - each operation in the pipeline - downloading the URL, extracting links, updating crawler state and so on.

This namespace contains defintions and examples.

Two major crawler bits:
- the pipeline - a crawl task from URL to saving a payload is a pipeline
- the pipeline components - each operation in the pipeline - downloading
  the URL, extracting links, updating crawler state and so on.

This namespace contains defintions and examples.
raw docstring

cljdoc builds & hosts documentation for Clojure/Script libraries

Keyboard shortcuts
Ctrl+kJump to recent docs
Move to previous article
Move to next article
Ctrl+/Jump to the search field
× close