Uses of Class
net.sf.eos.analyzer.TokenizerException

Packages that use TokenizerException

net.sf.eos.analyzer	The package contains classes and patterns to support analyzing of CharSequence.
net.sf.eos.analyzer.lucene	Contains adapter and support for reuse of Lucene Tokenizer.
net.sf.eos.entity	Support for named entity recognizer.
net.sf.eos.hadoop.mapred.cooccurrence	Main task of the εοs-toolkit mapreduce system to support cooccurrence based entity oriented search.
net.sf.eos.trie	Contains the base structure for memory based entity recognition.

Uses of TokenizerException in net.sf.eos.analyzer

Methods in net.sf.eos.analyzer that throw TokenizerException

static TokenizerSupplier	TokenizerSupplier.newInstance(Configuration config) Creates a new instance.
Token	WhitespaceTokenizer.next()
Token	Tokenizer.next() The next token or null.
abstract Token	TokenFilter.next() Implementations should use TokenFilter.getSource() to fetch the source Tokenizer an handle the resulting Token.
Token	SurroundingTokenFilter.next() Removes surrounding characters from the token text.
Token	StopTokenFilter.next()
Token	SentenceTokenizer.next()
Token	ResettableTokenFilter.next()
Token	CaseTokenFilter.next()
protected CharSequence	SentenceTokenizer.nextSentence() Override this method to implement a different sentence tokenizer.
void	WhitespaceTokenizer.reset(CharSequence input)
void	SentenceTokenizer.reset(CharSequence input)
void	ResettableTokenizer.reset(CharSequence input) Inits the tokenizer with new input data.
void	ResettableTokenFilter.reset(CharSequence input)

Uses of TokenizerException in net.sf.eos.analyzer.lucene

Methods in net.sf.eos.analyzer.lucene that throw TokenizerException

Token

LuceneTokenizerWrapper.next()

Uses of TokenizerException in net.sf.eos.entity

Methods in net.sf.eos.entity that throw TokenizerException

Token

SimpleLongestMatchDictionaryBasedEntityRecognizer.next() Returned Token may be of type EntityRecognizer.ENTITY_TYPE or any different type.

Uses of TokenizerException in net.sf.eos.hadoop.mapred.cooccurrence

Methods in net.sf.eos.hadoop.mapred.cooccurrence that throw TokenizerException

protected ResettableTokenizer	DictionaryBasedEntityRecognizerMapper.getTokenizer() Returns a Tokenizer as source for the recognizer.
protected ResettableTokenizer	DictionaryBasedEntityIdKeyGenerator.getTokenizer() Returns a Tokenizer as source for the recognizer.

Uses of TokenizerException in net.sf.eos.trie

Methods in net.sf.eos.trie that throw TokenizerException

static TrieLoader	AbstractTrieLoader.newInstance() Default TrieLoader is XmlTrieLoader.
static TrieLoader	AbstractTrieLoader.newInstance(Configuration config)