Uses of Package
opennlp.tools.tokenize

Packages that use opennlp.tools.tokenize

Package	Description
opennlp.tools.sentdetect
opennlp.tools.tokenize

Classes in opennlp.tools.tokenize used by opennlp.tools.sentdetect

Class	Description
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.

Classes in opennlp.tools.tokenize used by opennlp.tools.tokenize

Class	Description
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.
Detokenizer.DetokenizationOperation	This enum contains an operation for every token to merge the tokens together to their detokenized form.
Tokenizer	The interface for tokenizers, which segment a string into its tokens.
TokenSample	A TokenSample is text with token spans.
WhitespaceTokenizer	A basic Tokenizer implementation which performs tokenization using white spaces.