bandit.arms — bandit/bandit-core 0.2.0

Arms are used to track the performance of a bandit for the algorithm.

exploit clj

(exploit k arms)

identifies the arm with the highest value for (k arm)

mk-arm clj

(mk-arm name)

(mk-arm name & keyvals)

mk-arms clj

(mk-arms & names)

Creates a sorted map to hold onto the state of arms

pulled clj

(pulled {:keys [pulls] :as arm})

Record that we've pulled the arm. Allows the pull and reward to be tracked in separate events. e.g: (-> arm (pulled) (reward 0))

reward clj

(reward {:keys [pulls] :as arm} reward)

updates the arm given a reward (numeric value)

total-pulls clj

(total-pulls arms)

unpulled clj

(unpulled arms)

update clj

(update {:keys [name] :as arm} arms)

merges the updated arm back into arms

weighted-value clj

(weighted-value {:keys [pulls value] :as arm} reward)