First, import the library:
(require '[virtuoso.core :as v])
with-executor
The with-executor wraps a block of code binding a new instance of
VirtualThreadPerTaskExecutor to the passed symbol:
(v/with-executor [exe]
(do-this ...)
(do-that ...))
Above, the executor is bound to the exe symbol. Exiting from the macro will
trigger closing the executor, which, in turn, leads to blocking until all the
tasks sent to it are complete. The with-executor macro, although it might be
used on your code, is instead a building material for other macros.
future-via
The future-via macro spawns a new virtual future through a previously open
executor. You can generate as many futures as you want due to the nature of
virtual threads: there might be millions of them.
(v/with-executor [exe]
(let [f1 (v/future-via exe
(do-this ...))
f2 (v/future-via exe
(do-that ...))]
[@f1 @f2]))
Virtual futures give performance gain only when the code they wrap makes IO. Instead, if you run CPU-based computations in virtual threads, the performance suffers due to continuations and moving the stack trace from the stack to the heap and back.
futures(!)
The futures macro takes a series of forms. It spawns a new virtual thread
executor and wraps each form into a future bound to that executor. The result is
a vector of Future objects. To obtain values, pass the result through
(map/mapv deref ...):
(let [futs
(v/futures
(io-heavy-task-1 ...)
(io-heavy-task-2 ...)
(io-heavy-task-3 ...))]
(mapv deref futs))
Right before you exit the macro, it closes the executor, which leads to blicking until all the tasks are complete.
Pay attention that deref-ing a failed future leads to throwing an
exception. That's why the macro doesn't dereference the futures for you, as it
doesn't know how to handle errors. But if you don't care about exception
handling, there is a futures! macro that does it for you:
(v/futures!
(io-heavy-task-1 ...)
(io-heavy-task-2 ...)
(io-heavy-task-3 ...))
The result will be vector of dereferenced values.
thread
The thread macro spawns and starts a new virtual thread using the
(Thread/ofVirtual) call. Threads in Java do not return values; they can only
be join-ed or interrupted. Use this macro when interested in a Thread object
but not the result.
(let [thread1
(v/thread
(some-long-task ...))
thread2
(v/thread
(some-long-task ...))]
(.join thread1)
(.join thread2))
pmap(!)
The pmap function acts like the standard clojure.core/pmap: it takes a
function and a collection (or more collections). It opens a new virtual executor
and submits each calculation step to the executor. The result is a vector of
futures. The function closes the executor afterwards, blocking until all the
tasks are complete.
(let [futs
(v/pmap get-user-from-api [1 2 3])]
(mapv deref futs))
Or:
(let [futs
(v/pmap get-some-entity ;; assuming it accepts id and status
[1 2 3] ;; ids
["active" "pending" "deleted"] ;; statuses
)]
(mapv deref futs))
The pmap! version of this function dereferences all the results for you with
no exception handling:
(v/pmap! get-user-from-api [1 2 3])
;; [{:id 1...}, {:id 2...}, {:id 3...}]
each(!)
The each macro is a wrapper on top of pmap. It binds each item from a
collection to a given symbol and submits a code block into a virtual
executor. The result is a vector of futures; exiting the macro closes the
executor.
(let [futs
(v/each [id [1 2 3]]
(log/info...)
(try
(get-entity-by-id id)
(catch Throwable e
(log/error e ...))))]
(is (= [{...}, {...}, {...}] (mapv deref futs))))
The each! macro acts the same but dereferences all the futures with no error
handling.
Can you improve this documentation?Edit on GitHub
cljdoc builds & hosts documentation for Clojure/Script libraries
| Ctrl+k | Jump to recent docs |
| ← | Move to previous article |
| → | Move to next article |
| Ctrl+/ | Jump to the search field |