ductile.document — threatgrid/ductile 0.1.0-SNAPSHOT

bulk-create-doc clj

(bulk-create-doc conn docs opts)

(bulk-create-doc conn docs opts max-size)

Inputs: ([conn :- ESConn docs :- [s/Any] opts :- CRUDOptions] [conn :- ESConn docs :- [s/Any] opts :- CRUDOptions max-size :- (s/maybe s/Int)])

create multiple documents on ES and return the created documents

bulk-index clj

(bulk-index documents)

generates the content for a bulk insert operation

bulk-uri clj

(bulk-uri uri)

make an uri for bulk action

byte-size clj

(byte-size s)

Count the size of the given string in bytes.

count-docs clj

(count-docs es-conn index-name)

(count-docs {:keys [uri cm]} index-name query)

Inputs: ([{:keys [uri cm]} :- ESConn index-name :- s/Str query :- (s/maybe ESQuery)] [es-conn :- ESConn index-name :- s/Str])

Count documents on ES matching given query.

count-uri clj

(count-uri uri index-name)

make an uri for search action

create-doc clj

(create-doc es-conn index-name doc opts)

Inputs: [es-conn :- ESConn index-name :- s/Str doc :- s/Any opts :- CRUDOptions]

create a document on es return the created document

default-limit clj

default-retry-on-conflict clj

delete-by-query clj

(delete-by-query {:keys [uri cm]} index-names q opts)

Inputs: [{:keys [uri cm]} :- ESConn index-names :- [s/Str] q :- ESQuery opts :- CRUDOptions]

delete all documents that match a query in an index

delete-by-query-uri clj

(delete-by-query-uri uri index-names)

Inputs: [uri index-names]

delete-doc clj

(delete-doc {:keys [uri cm]} index-name id opts)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str id :- s/Str opts :- CRUDOptions]

delete a document on es, returns boolean

delete-doc-uri clj

make an uri for doc deletion

generate-search-params clj

(generate-search-params query aggs params)

get-doc clj

(get-doc {:keys [uri cm]} index-name id opts)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str id opts :- CRUDOptions]

get a document on es and return only the source

get-doc-uri clj

make an uri for doc retrieval

index-doc clj

(index-doc es-conn index-name doc)

(index-doc es-conn index-name doc opts)

Inputs: ([es-conn :- ESConn index-name :- s/Str doc :- s/Any opts :- CRUDOptions] [es-conn index-name doc])

index a document on es return the indexed document

index-doc-internal clj

(index-doc-internal {:keys [uri cm]}
                    index-name
                    doc
                    {:keys [mk-id] :or {mk-id :id} :as opts})

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str doc :- s/Any {:keys [mk-id], :or {mk-id :id}, :as opts} :- CRUDOptions]

index-doc-uri clj

(index-doc-uri uri index-name id)

make an uri for document index

index-operation clj

(index-operation doc)

helper to prepare a bulk insert operation

params->pagination clj

(params->pagination {:keys [sort_by sort_order offset limit search_after]
                     :or {sort_order :asc limit pagination/default-limit}})

partition-json-ops clj

(partition-json-ops json-ops max-size)

Return a lazy sequence of lists of ops whose size is less than max-size. If a json-op exceeds the max size, it is included in a list of one element.

query clj

(query es-conn index-name q params)

(query {:keys [uri cm]} index-name q aggs {:keys [full-hits?] :as params})

Inputs: ([{:keys [uri cm]} :- ESConn index-name :- (s/maybe s/Str) q :- (s/maybe ESQuery) aggs :- (s/maybe ESAggs) {:keys [full-hits?], :as params} :- s/Any] [es-conn index-name q params])

Search for documents on ES using any query. Performs aggregations when specified.

search-docs clj

(search-docs es-conn index-name es-query all-of params)

Inputs: [es-conn :- ESConn index-name :- (s/maybe s/Str) es-query :- (s/maybe ESQuery) all-of :- (s/maybe #:s{Any s/Any}) params :- s/Any]

Search for documents on ES using a query string search. Also applies a filter map, converting the values in the all-of into must match terms.

search-uri clj

(search-uri uri index-name)

make an uri for search action

sort-params clj

(sort-params sort_by sort_order)

update-doc clj

(update-doc {:keys [uri cm]} index-name id doc opts)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str id :- s/Str doc :- s/Any opts :- CRUDOptions]

update a document on es return the updated document

update-doc-uri clj

(update-doc-uri uri index-name id)

make an uri for document update