tech.s3.core — techascent/tech.s3 0.3.0

byte-array-to-md5 clj

(byte-array-to-md5 byte-data)

CREDS* clj

CREDS-LOCK* clj

delete-object-cloud clj

(delete-object-cloud bucket k)

download-object clj

(download-object bucket k)

Getting the s3 object into the local location. Useful for situations where dealing with streams or ByteArrays isn't the preferred method of consumption.

empty-file-md5 clj

file-exists? clj

(file-exists? path)

Takes a path and returns true if a file exists.

get-content-type clj

(get-content-type fname)

get-nippy clj

(get-nippy bucket key)

Get a nippy blob from s3. The caller must have taoensso.nippy in their project.

get-object clj

(get-object bucket k)

Get an object given a bucket and key. NOTE: Returns a stream that you have to remember to close.

get-object-bytes clj

(get-object-bytes bucket k)

Get an object given a bucket and key. NOTE: Returns a realized byte-array rather than a stream.

get-object-cloud clj

(get-object-cloud bucket k)

get-object-local clj

(get-object-local bucket k)

Retrieves a file from the local cache.

get-object-metadata clj

(get-object-metadata bucket key)

get-s3-creds clj

(get-s3-creds)

If global creds are setup, grab whatever they are. Else try to find them via the config

is-cached-locally? clj

(is-cached-locally? bucket k)

Determines if a given bucket/key has already been downloaded to the local cache.

is-expired-token? clj

(is-expired-token? exception)

is-invalid-access-key? clj

(is-invalid-access-key? exception)

is-null-access-key? clj

(is-null-access-key? exception)

lazy-object-list-seq clj

(lazy-object-list-seq bucket prefix & [marker])

list-local-objects clj

(list-local-objects bucket prefix)

List the local objects. No attempt is made to unify this output with the output of list objects

list-objects clj

(list-objects bucket prefix)

list-prefixes clj

(list-prefixes bucket)

list-some-objects clj

(list-some-objects bucket prefix & {:keys [marker]})

List objects given a bucket and prefix

local-exists-and-latest? clj

(local-exists-and-latest? bucket k)

True iff the cached file exists and is up to date with the s3 version.

local-s3-path clj

(local-s3-path bucket k)

Get the path for a given s3 item in the local cache

needs-new-cred-request? clj

(needs-new-cred-request? &
                         {:keys [current-time]
                          :or {current-time (System/currentTimeMillis)}})

put-nippy clj

(put-nippy bucket key data)

Put a nippy blob on s3. The caller must have taoensso.nippy in their project.

put-object clj

(put-object bucket k v & {:keys [metadata verify-md5?] :or {metadata {}}})

Put an object into a given bucket and key. V can be an input stream, a file, or a string.

put-object-cloud clj

(put-object-cloud bucket k v & {:keys [metadata] :or {metadata {}}})

put-object-local clj

(put-object-local bucket k v)

update-creds! clj

(update-creds!)

Do a vault query to get new vault creds.

with-credential-update clj/s macro

(with-credential-update & body)

Attempt an s3 operation. If the operation fails with an invalid access key, request new aws credentials from vault exactly once. Continue attempting operation until it either fails with a different exception, succeeds