nd-db.core — com.luposlip/nd-db 0.5.2

combinr clj

(combinr)

(combinr _)

(combinr acc more)

create-index clj

(create-index filename idx-id)

Builds up an index of Entity IDs as keys (IDs extracted with id-fn), and as value a vector with 2 values:

• the start index in the text file to start read EDN for the input doc
• the length in bytes input doc

db clj

(db _params)

Tries to read the specified pre-parsed database from filesystem. If this cannot be found, creates and persists a new one.

Params: :id-rx-str - Regular expression STRING REPRESENTATION to retrieve unique ID from the data. The second match is used as the ID. The string is used to name the serialized index. NB: Regular expressions is often much faster than parsing and inspecting data! :id-fn - For more complex parsing/indexing, you can supply a function instead of a regular expression. Only do this, if you are certain it's faster than regex! NB: Only the content of the database will be used to name the persisted index. This using different ID functions will overwrite previously persisted indices where :id-fn is also used! :id-name - Convenience parameter - if you just want to supply the name of the ID in the text based data to search for - creates a regex under the hood. Should be used with the next parameter for optimal speed. :id-type - The type of data to store as ID (key) in the index :source-type - If the source-type is different from the ID type to store in the index :index-folder - Folder to persist index in, defaults to system temp folder :index-persist? - Set to false to inhibit storing the index on disk, defaults to true. Will also inhibit the use of previously persisted indices!

index-fns clj

In the form {"filename1" {"9298cvoa" {index-w-first-few-ids-as-str-=-9298cvoa} "filename2" {"ao3oijf8" {index-w-first-few-ids-as-str-=-ao3oijf8}}}

index-id clj

(index-id {:keys [filename id-fn]})

This function generates a pseudo unique index ID for the combination of the ID function and the filename.

infer-doctype clj

(infer-doctype filename)

parse-doc clj

(parse-doc db doc-str)

parse-params clj

(parse-params {:keys [filename id-fn id-rx-str id-name id-type index-folder
                      index-persist?]
               :as params})

Parses input params for intake of raw-db

q clj multimethod

Queries a single or multiple docs from the database by a single or multiple IDs matching those from the .nd* database by id-fn.

• returns EDN for the matching document.

raw-db clj

(raw-db {:keys [id-fn filename] :as params})

Creates a database var which can be used to perform queries

reducr clj

(reducr id-fn)