Uses of Interface
net.sf.eos.analyzer.Token

Packages that use Token

net.sf.eos.analyzer	The package contains classes and patterns to support analyzing of CharSequence.
net.sf.eos.analyzer.lucene	Contains adapter and support for reuse of Lucene Tokenizer.
net.sf.eos.entity	Support for named entity recognizer.

Uses of Token in net.sf.eos.analyzer

Classes in net.sf.eos.analyzer that implement Token

class

AbstractToken Simple implementation for reuse.

Methods in net.sf.eos.analyzer that return Token

Token	WhitespaceTokenizer.next()
Token	Tokenizer.next() The next token or null.
abstract Token	TokenFilter.next() Implementations should use TokenFilter.getSource() to fetch the source Tokenizer an handle the resulting Token.
Token	SurroundingTokenFilter.next() Removes surrounding characters from the token text.
Token	StopTokenFilter.next()
Token	SentenceTokenizer.next()
Token	ResettableTokenFilter.next()
Token	CaseTokenFilter.next()

Methods in net.sf.eos.analyzer with parameters of type Token

abstract CharSequence	TextBuilder.buildText(Token... tokens) Creates a new text from the given token.
CharSequence	TextBuilder.SpaceBuilder.buildText(Token... tokens)

Method parameters in net.sf.eos.analyzer with type arguments of type Token

abstract CharSequence	TextBuilder.buildText(List<Token> tokens) Creates a new text from the given token.
CharSequence	TextBuilder.SpaceBuilder.buildText(List<Token> tokens)

Constructors in net.sf.eos.analyzer with parameters of type Token

AbstractToken(Token t)
Copy constuctor.

Uses of Token in net.sf.eos.analyzer.lucene

Methods in net.sf.eos.analyzer.lucene that return Token

Token

LuceneTokenizerWrapper.next()

Uses of Token in net.sf.eos.entity

Methods in net.sf.eos.entity that return Token

Token

SimpleLongestMatchDictionaryBasedEntityRecognizer.next() Returned Token may be of type EntityRecognizer.ENTITY_TYPE or any different type.