Liking cljdoc? Tell your friends :D

uncomplicate.illamanati.internal.tokenizer.streaming-decoder


bpe-lookup-arrayclj

(bpe-lookup-array)

bpe-reconstruct-lookupclj

(bpe-reconstruct-lookup vocabulary-lookup)

huf-vocabulary-arrayclj

(huf-vocabulary-array is)

sentencepiece-lookupclj

(sentencepiece-lookup c)

str->buffer!clj

(str->buffer! bpe-lookup token res!)

streaming-decoderclj

(streaming-decoder vocabulary-source)
(streaming-decoder vocabulary-stream capacity)
(streaming-decoder bpe-lookup vocabulary-lookup capacity)

cljdoc builds & hosts documentation for Clojure/Script libraries

Keyboard shortcuts
Ctrl+kJump to recent docs
Move to previous article
Move to next article
Ctrl+/Jump to the search field
× close