clj-momo.lib.es.document — threatgrid/clj-momo 0.2.31-SNAPSHOT

bulk-create-doc clj

(bulk-create-doc conn docs refresh?)

(bulk-create-doc conn docs refresh? max-size)

Inputs: ([conn :- ESConn docs :- [s/Any] refresh? :- Refresh] [conn :- ESConn docs :- [s/Any] refresh? :- Refresh max-size :- (s/maybe s/Int)])

create multiple documents on ES and return the created documents

bulk-index clj

(bulk-index documents)

generates the content for a bulk insert operation

bulk-uri clj

(bulk-uri uri)

make an uri for bulk action

byte-size clj

(byte-size s)

Count the size of the given string in bytes.

count-docs clj

(count-docs es-conn index-name mapping)

(count-docs {:keys [uri cm]} index-name mapping query)

Inputs: ([{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- (s/maybe s/Str) query :- (s/maybe ESQuery)] [es-conn :- ESConn index-name :- s/Str mapping :- (s/maybe s/Str)])

Count documents on ES matching given query.

count-uri clj

(count-uri uri index-name mapping)

make an uri for search action

create-doc clj

(create-doc {:keys [uri cm]} index-name mapping {:keys [id] :as doc} refresh?)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str {:keys [id], :as doc} :- s/Any refresh? :- Refresh]

create a document on es return the created document

create-doc-uri clj

(create-doc-uri uri index-name mapping id)

make an uri for document creation

default-limit clj

default-retry-on-conflict clj

delete-doc clj

(delete-doc {:keys [uri cm]} index-name mapping id refresh?)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str id :- s/Str refresh? :- Refresh]

delete a document on es, returns boolean

delete-doc-uri clj

make an uri for doc deletion

generate-es-params clj

(generate-es-params query params)

get-doc clj

(get-doc {:keys [uri cm]} index-name mapping id params)

Inputs: [{:keys [uri cm]} :- ESConn index-name mapping id params]

get a document on es and return only the source

get-doc-uri clj

make an uri for doc retrieval

index-operation clj

(index-operation doc)

helper to prepare a bulk insert operation

params->pagination clj

(params->pagination
  {:keys [sort_by sort_order offset limit search_after]
   :or {sort_by :_uid sort_order :asc offset 0 limit pagination/default-limit}})

partition-json-ops clj

(partition-json-ops json-ops max-size)

Return a lazy sequence of lists of ops whose size is less than max-size. If a json-op exceeds the max size, it is included in a list of one element.

query clj

(query {:keys [uri cm]} index-name mapping query params)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str query :- ESQuery params :- s/Any]

Search for documents on ES using any query.

search-docs clj

(search-docs es-conn index-name mapping es-query all-of params)

Inputs: [es-conn :- ESConn index-name :- s/Str mapping :- s/Str es-query :- (s/maybe ESQuery) all-of :- (s/maybe #:s{Any s/Any}) params :- s/Any]

Search for documents on ES using a query string search. Also applies a filter map, converting the values in the all-of into must match terms.

search-uri clj

(search-uri uri index-name mapping)

make an uri for search action

sort-params clj

(sort-params sort_by sort_order)

update-doc clj

(update-doc {:keys [uri cm]}
            index-name
            mapping
            id
            doc
            refresh?
            &
            [{:keys [retry-on-conflict]
              :or {retry-on-conflict default-retry-on-conflict}}])

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str id :- s/Str doc :- s/Any refresh? :- Refresh & [{:keys [retry-on-conflict], :or {retry-on-conflict default-retry-on-conflict}}]]

update a document on es return the updated document

update-doc-uri clj

(update-doc-uri uri index-name mapping id retry-on-conflict)

make an uri for document update