org.languagetool.tokenizers

Class SRXSentenceTokenizer

Object

SentenceTokenizer

SRXSentenceTokenizer

All Implemented Interfaces:

Tokenizer

public class SRXSentenceTokenizer
extends SentenceTokenizer

Class to tokenize sentences using an SRX file.

Author:

Marcin Miłkowski

Constructor Summary

Constructors

Constructor and Description
SRXSentenceTokenizer(String language)

Method Summary

Methods

Modifier and Type	Method and Description
void	setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)
boolean	singleLineBreaksMarksPara()
List<String>	tokenize(String text) Tokenize the given string to sentences.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SRXSentenceTokenizer

public SRXSentenceTokenizer(String language)

Method Detail

tokenize

public final List<String> tokenize(String text)

Description copied from class: SentenceTokenizer

Tokenize the given string to sentences.

Specified by:

tokenize in interface Tokenizer

Overrides:

tokenize in class SentenceTokenizer

singleLineBreaksMarksPara

public final boolean singleLineBreaksMarksPara()

Overrides:

singleLineBreaksMarksPara in class SentenceTokenizer

setSingleLineBreaksMarksParagraph

public final void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)

Overrides:

setSingleLineBreaksMarksParagraph in class SentenceTokenizer

Parameters:

lineBreakParagraphs - if true, single lines breaks are assumed to end a paragraph, with false, only two ore more consecutive line breaks end a paragraph