reaver — reaver 0.1.3

attr clj

(attr attribute)

(attr x attribute)

Convenience function allowing:

(chain (attr :href) ..)

instead of requiring:

(chain #(attr* % :href) ..)

chain clj

(chain & fns)

Executes the supplied functions in left to right order on an element.

(chain text parse-date)

EDNable clj protocol

to-edn clj

(to-edn jsoup)

Converts Jsoup into an edn representation of HTML.

{:type Keyword :tag Keyword|nil :attrs {Keyword String, ...}|nil :content Vector|Map|String|nil}

extract clj

(extract source ks & extractions)

ks is a vector of keys that will be zipped into a map with the extracted data, ie:

{(first ks) (first (run-extractions source extractions))}

If ks is nil or empty, a sequence of extracted data will be returned instead.

Extractions are a selector (see select) followed by an extractor (see Extractable).

(extract (parse subreddit) [:headlines] ".sitetable .thing .title a.title" text)

extract-from clj

(extract-from source selector ks & extractions)

Behaves like extract, but prior to running extractions uses the provided selector to narrow down the data to be searched.

This is useful, for instance, when one wants to select a sequence of items, then extract identical information from each.

Extractable clj protocol

attr* clj

(attr* x a)

Returns a string representing the node's value for the supplied attribute (or nil, if it has no value)

attrs clj

(attrs x)

Returns a map of keyword/string pairs representing the node's attributes.

data clj

(data x)

Returns a string representing all the data (ie. from scripts) contained by the node.

edn clj

(edn x)

Returns data in edn format.

jsoup clj

(jsoup x)

Returns data in Jsoup types.

tag clj

(tag x)

Returns a keyword representing the node's html tag (if it has one)

text clj

(text x)

Returns a string representing all the text contained by the node.

one? clj

(one? elements)

parse clj

(parse html)

Parses a string representing a full HTML document into Jsoup.

parse-fragment clj

(parse-fragment html)

Parses a string representing a fragment of HTML into Jsoup.

reduce-into clj

(reduce-into empty-coll xs)

Imperfectly mimics 'into' with 'reduce' and 'conj' for better performance.

run-extraction clj

(run-extraction source sel extraction)

run-extractions clj

(run-extractions source extractions)

select clj

(select node css-selector)

Given HTML parsed to Jsoup and a string representing a CSS-esque selector, select* returns Jsoup representing any successfully selected data.

For more on selector syntax, see: http://jsoup.org/cookbook/extracting-data/selector-syntax