org.languagetool.tokenizers.gl

Class GalicianWordTokenizer

java.lang.Object

org.languagetool.tokenizers.WordTokenizer

org.languagetool.tokenizers.gl.GalicianWordTokenizer

All Implemented Interfaces:

Tokenizer

public class GalicianWordTokenizer
extends WordTokenizer

Tokenizes a sentence into words. Punctuation and whitespace gets its own token.

Author:

Daniel Naber

Constructor Summary

Constructors

Constructor and Description
GalicianWordTokenizer()

Method Summary

Modifier and Type	Method and Description
List<String>	tokenize(String text)

Methods inherited from class org.languagetool.tokenizers.WordTokenizer

getProtocols, getTokenizingCharacters, isEMail, isUrl, joinEMails, joinEMailsAndUrls, joinUrls

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GalicianWordTokenizer

public GalicianWordTokenizer()

Method Detail

tokenize

public List<String> tokenize(String text)

Specified by:

tokenize in interface Tokenizer

Overrides:

tokenize in class WordTokenizer