Contains default components
Contains default components
(add-location-config user-config)
Given a user-config, returns a new config with location info added to it
Given a user-config, returns a new config with location info added to it
(default-filter obj config)
By default, we ignore robots.txt urls
By default, we ignore robots.txt urls
(default-stop-check obj config)
Stops at 100 documents. This function is part of the crawl pipeline but doesn't use any of the objects being passed through it; it only looks at the crawl-state.
Stops at 100 documents. This function is part of the crawl pipeline but doesn't use any of the objects being passed through it; it only looks at the crawl-state.
(get-request url user-agent)
(get-request url user-agent socket-timeout conn-timeout)
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close