public final class WordTokenFilter
extends org.apache.lucene.analysis.TokenFilter
TokenFilter
that breaks sentences into words.
WARNING: The status of the analyzers/smartcn analysis.cn.smart package is experimental. The APIs and file formats introduced here might change in the future and will not be supported anymore in such a case.
Constructor and Description |
---|
WordTokenFilter(org.apache.lucene.analysis.TokenStream in)
Construct a new WordTokenizer.
|
Modifier and Type | Method and Description |
---|---|
boolean |
incrementToken() |
void |
reset() |
getOnlyUseNewAPI, next, next, setOnlyUseNewAPI
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
public WordTokenFilter(org.apache.lucene.analysis.TokenStream in)
in
- TokenStream
of sentencespublic boolean incrementToken() throws java.io.IOException
incrementToken
in class org.apache.lucene.analysis.TokenStream
java.io.IOException
public void reset() throws java.io.IOException
reset
in class org.apache.lucene.analysis.TokenFilter
java.io.IOException
Copyright © 2000-2019 Apache Software Foundation. All Rights Reserved.