All notable changes to this project are documented here. The format follows Keep a Changelog, and the project adheres to Semantic Versioning.
Initial release.
chunk.core/split - recursive text splitter for RAG / LLM pipelines. Splits text
into overlapping chunks no larger than a target size, trying ordered separators
(paragraph -> line -> word -> character) so chunks land on natural boundaries.:chunk-size, :overlap, :separators, and a pluggable :length-fn
(default count = characters) so you can chunk by tokens instead - e.g. with
tokenizers-clj's count-tokens.Can you improve this documentation?Edit on GitHub
cljdoc builds & hosts documentation for Clojure/Script libraries
| Ctrl+k | Jump to recent docs |
| ← | Move to previous article |
| → | Move to next article |
| Ctrl+/ | Jump to the search field |