A bounded, reference-counted cache of native decision model sessions.
A bounded, reference-counted cache of native decision model sessions.
(begin-training!)Exclusively reserve the decision model memory budget for a CPU trainer. Reject active inference or loads; release only idle sessions before starting.
Exclusively reserve the decision model memory budget for a CPU trainer. Reject active inference or loads; release only idle sessions before starting.
(enable!)Allow new allocations after the gateway starts. Old retiring leases are not reused.
Allow new allocations after the gateway starts. Old retiring leases are not reused.
(end-training!)Release the exclusive trainer reservation, including after cancellation.
Release the exclusive trainer reservation, including after cancellation.
(release-idle!)Evict idle sessions without preventing new allocations.
Evict idle sessions without preventing new allocations.
(shutdown!)Retire every session. Idle sessions close now, active leases on final release. A load that returns after shutdown is closed without entering the cache.
Retire every session. Idle sessions close now, active leases on final release. A load that returns after shutdown is closed without entering the cache.
(status key)Resident state for an immutable model key; installed files are checked separately.
Resident state for an immutable model key; installed files are checked separately.
(with-resident! key weight-bytes loader operation)Use one immutable version. Cold requests share one load; idle LRU closes before a
new load. weight-bytes sizes its memory reservation. All waits and reservations
are bounded; no active native session closes.
Use one immutable version. Cold requests share one load; idle LRU closes before a new load. `weight-bytes` sizes its memory reservation. All waits and reservations are bounded; no active native session closes.
cljdoc builds & hosts documentation for Clojure/Script libraries
| Ctrl+k | Jump to recent docs |
| ← | Move to previous article |
| → | Move to next article |
| Ctrl+/ | Jump to the search field |