Liking cljdoc? Tell your friends :D

clj-zemberek.tokenization


antlr-tokenizationclj

(antlr-tokenization input)

Low level tokenization iterator using Ant-lr Lexer.

Low level tokenization iterator using Ant-lr Lexer.
sourceraw docstring

detectorclj

source

lexerclj

source

sentencesclj

(sentences input)

Sentence Boundary Detection

Sentence Boundary Detection
sourceraw docstring

simple-tokenizationclj

(simple-tokenization input)

Simple tokenization returns a list of token strings.

Simple tokenization returns a list of token strings.
sourceraw docstring

cljdoc is a website building & hosting documentation for Clojure/Script libraries

× close