|
||||||||||
| PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES | |||||||||
| Interface Summary | |
|---|---|
| Tokenizer | Interface for classes that tokenize text into smaller units. |
| Class Summary | |
|---|---|
| SentenceTokenizer | Tokenizes text into sentences by looking for typical end-of-sentence markers, but considering exceptions (e.g. abbreviations). |
| WordTokenizer | Tokenizes a sentence into words. |
|
||||||||||
| PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES | |||||||||