clj-momo.lib.es.document — threatgrid/clj-momo 0.3.4

bulk-create-doc clj

(bulk-create-doc conn docs refresh?)

(bulk-create-doc conn docs refresh? max-size)

Inputs: ([conn :- ESConn docs :- [s/Any] refresh? :- Refresh] [conn :- ESConn docs :- [s/Any] refresh? :- Refresh max-size :- (s/maybe s/Int)])

create multiple documents on ES and return the created documents

bulk-index clj

(bulk-index documents)

generates the content for a bulk insert operation

bulk-uri clj

(bulk-uri uri)

make an uri for bulk action

byte-size clj

(byte-size s)

Count the size of the given string in bytes.

count-docs clj

(count-docs es-conn index-name mapping)

(count-docs {:keys [uri cm]} index-name mapping query)

Inputs: ([{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- (s/maybe s/Str) query :- (s/maybe ESQuery)] [es-conn :- ESConn index-name :- s/Str mapping :- (s/maybe s/Str)])

Count documents on ES matching given query.

count-uri clj

(count-uri uri index-name mapping)

make an uri for search action

create-doc clj

(create-doc es-conn index-name mapping doc refresh?)

Inputs: [es-conn :- ESConn index-name :- s/Str mapping :- s/Str doc :- s/Any refresh? :- Refresh]

create a document on es return the created document

default-limit clj

default-retry-on-conflict clj

delete-by-query clj

(delete-by-query {:keys [uri cm]}
                 index-names
                 mapping
                 q
                 wait-for-completion?
                 refresh?)

Inputs: [{:keys [uri cm]} :- ESConn index-names :- [s/Str] mapping :- (s/maybe s/Str) q :- ESQuery wait-for-completion? :- s/Bool refresh? :- Refresh]

delete all documents that match a query in an index

delete-by-query-uri clj

(delete-by-query-uri uri index-names mapping)

Inputs: [uri index-names mapping]

delete-doc clj

(delete-doc {:keys [uri cm]} index-name mapping id refresh?)

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str id :- s/Str refresh? :- Refresh]

delete a document on es, returns boolean

delete-doc-uri clj

make an uri for doc deletion

generate-es-params clj

(generate-es-params query aggs params)

get-doc clj

(get-doc {:keys [uri cm]} index-name mapping id params)

Inputs: [{:keys [uri cm]} :- ESConn index-name mapping id params]

get a document on es and return only the source

get-doc-uri clj

make an uri for doc retrieval

index-doc clj

(index-doc es-conn index-name mapping doc refresh?)

Inputs: [es-conn :- ESConn index-name :- s/Str mapping :- s/Str doc :- s/Any refresh? :- Refresh]

index a document on es return the indexed document

index-doc-internal clj

(index-doc-internal {:keys [uri cm]}
                    index-name
                    mapping
                    {:keys [id] :as doc}
                    {:keys [refresh op_type]})

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str {:keys [id], :as doc} :- s/Any {:keys [refresh op_type]}]

index-doc-uri clj

(index-doc-uri uri index-name mapping id)

make an uri for document index

index-operation clj

(index-operation doc)

helper to prepare a bulk insert operation

params->pagination clj

(params->pagination {:keys [sort_by sort_order offset limit search_after]
                     :or {sort_order :asc limit pagination/default-limit}})

partition-json-ops clj

(partition-json-ops json-ops max-size)

Return a lazy sequence of lists of ops whose size is less than max-size. If a json-op exceeds the max size, it is included in a list of one element.

query clj

(query es-conn index-name mapping q params)

(query {:keys [uri cm]}
       index-name
       mapping
       q
       aggs
       {:keys [full-hits? scroll] :as params})

Inputs: ([{:keys [uri cm]} :- ESConn index-name :- (s/maybe s/Str) mapping :- (s/maybe s/Str) q :- (s/maybe ESQuery) aggs :- (s/maybe ESAggs) {:keys [full-hits? scroll], :as params} :- s/Any] [es-conn index-name mapping q params])

Search for documents on ES using any query. Performs aggregations when specified.

search-docs clj

(search-docs es-conn index-name mapping es-query all-of params)

Inputs: [es-conn :- ESConn index-name :- (s/maybe s/Str) mapping :- (s/maybe s/Str) es-query :- (s/maybe ESQuery) all-of :- (s/maybe #:s{Any s/Any}) params :- s/Any]

Search for documents on ES using a query string search. Also applies a filter map, converting the values in the all-of into must match terms.

search-uri clj

(search-uri uri index-name mapping)

make an uri for search action

sort-params clj

(sort-params sort_by sort_order)

update-doc clj

(update-doc {:keys [uri cm]}
            index-name
            mapping
            id
            doc
            refresh?
            &
            [{:keys [retry-on-conflict]
              :or {retry-on-conflict default-retry-on-conflict}}])

Inputs: [{:keys [uri cm]} :- ESConn index-name :- s/Str mapping :- s/Str id :- s/Str doc :- s/Any refresh? :- Refresh & [{:keys [retry-on-conflict], :or {retry-on-conflict default-retry-on-conflict}}]]

update a document on es return the updated document

update-doc-uri clj

(update-doc-uri uri index-name mapping id retry-on-conflict)

make an uri for document update