TokenTypeSinkFilter
and TeeSinkTokenFilter
instead.public class TokenTypeSinkTokenizer extends SinkTokenizer
Token.type()
matches the passed in typeToMatch
then
add it to the sinkAttributeSource.AttributeFactory, AttributeSource.State
iter, lst
Constructor and Description |
---|
TokenTypeSinkTokenizer(int initCap,
java.lang.String typeToMatch)
Deprecated.
|
TokenTypeSinkTokenizer(java.util.List input,
java.lang.String typeToMatch)
Deprecated.
|
TokenTypeSinkTokenizer(java.lang.String typeToMatch)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
void |
add(Token t)
Deprecated.
Override this method to cache only certain tokens, or new tokens based
on the old tokens.
|
close, getTokens, next, reset
correctOffset, reset
end, getOnlyUseNewAPI, incrementToken, next, setOnlyUseNewAPI
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
public TokenTypeSinkTokenizer(java.lang.String typeToMatch)
public TokenTypeSinkTokenizer(int initCap, java.lang.String typeToMatch)
public TokenTypeSinkTokenizer(java.util.List input, java.lang.String typeToMatch)
public void add(Token t)
SinkTokenizer
add
in class SinkTokenizer
t
- The Token
to add to the sinkCopyright © 2000-2019 Apache Software Foundation. All Rights Reserved.