# Uses of Package
opennlp.tools.tokenize.uax29

Packages that use opennlp.tools.tokenize.uax29
Package
Description
opennlp.tools.tokenize.uax29
opennlp.tools.util.normalizer

- Classes in opennlp.tools.tokenize.uax29 used by opennlp.tools.tokenize.uax29
  Class
  Description
  WordBreak
  The Unicode `Word_Break` property values, used by the UAX #29 word boundary algorithm.
  WordSegmenter.SegmentConsumer
  Receives each word segment as the half-open character range `[start, end)`.
  WordToken
  A word token produced by `WordTokenizer`: the character `Span` into the source text together with its `WordType`.
  WordTokenizer.TokenHandler
  Receives each word token as a character range and its type, with no allocation.
  WordType
  The category of a word token.
- Classes in opennlp.tools.tokenize.uax29 used by opennlp.tools.util.normalizer
  Class
  Description
  WordTokenizer
  A word tokenizer built on the Unicode Text Segmentation algorithm (UAX #29).