TokenRangeSinkFilter
and TeeSinkTokenFilter
instead.public class TokenRangeSinkTokenizer extends SinkTokenizer
AttributeSource.AttributeFactory, AttributeSource.State
iter, lst
Constructor and Description |
---|
TokenRangeSinkTokenizer(int lower,
int upper)
Deprecated.
|
TokenRangeSinkTokenizer(int initCap,
int lower,
int upper)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
void |
add(Token t)
Deprecated.
Override this method to cache only certain tokens, or new tokens based
on the old tokens.
|
void |
reset()
Deprecated.
Reset the internal data structures to the start at the front of the list of tokens.
|
close, getTokens, next
correctOffset, reset
end, getOnlyUseNewAPI, incrementToken, next, setOnlyUseNewAPI
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
public TokenRangeSinkTokenizer(int lower, int upper)
public TokenRangeSinkTokenizer(int initCap, int lower, int upper)
public void add(Token t)
SinkTokenizer
add
in class SinkTokenizer
t
- The Token
to add to the sinkpublic void reset() throws java.io.IOException
SinkTokenizer
SinkTokenizer.next(Token)
reset
in class SinkTokenizer
java.io.IOException
Copyright © 2000-2018 Apache Software Foundation. All Rights Reserved.