public class TokenSources
extends java.lang.Object
Constructor and Description |
---|
TokenSources() |
Modifier and Type | Method and Description |
---|---|
static TokenStream |
getAnyTokenStream(IndexReader reader,
int docId,
java.lang.String field,
Analyzer analyzer)
A convenience method that tries a number of approaches to getting a token stream.
|
static TokenStream |
getAnyTokenStream(IndexReader reader,
int docId,
java.lang.String field,
Document doc,
Analyzer analyzer)
A convenience method that tries to first get a TermPositionVector for the specified docId, then, falls back to
using the passed in
Document to retrieve the TokenStream. |
static TokenStream |
getTokenStream(Document doc,
java.lang.String field,
Analyzer analyzer) |
static TokenStream |
getTokenStream(IndexReader reader,
int docId,
java.lang.String field) |
static TokenStream |
getTokenStream(IndexReader reader,
int docId,
java.lang.String field,
Analyzer analyzer) |
static TokenStream |
getTokenStream(java.lang.String field,
java.lang.String contents,
Analyzer analyzer) |
static TokenStream |
getTokenStream(TermPositionVector tpv) |
static TokenStream |
getTokenStream(TermPositionVector tpv,
boolean tokenPositionsGuaranteedContiguous)
Low level api.
|
public static TokenStream getAnyTokenStream(IndexReader reader, int docId, java.lang.String field, Document doc, Analyzer analyzer) throws java.io.IOException
Document
to retrieve the TokenStream. This is useful when
you already have the document, but would prefer to use the vector first.reader
- The IndexReader
to use to try and get the vector fromdocId
- The docId to retrieve.field
- The field to retrieve on the documentdoc
- The document to fall back onanalyzer
- The analyzer to use for creating the TokenStream if the vector doesn't existTokenStream
for the Fieldable
on the Document
java.io.IOException
- if there was an error loadingpublic static TokenStream getAnyTokenStream(IndexReader reader, int docId, java.lang.String field, Analyzer analyzer) throws java.io.IOException
reader
- docId
- field
- analyzer
- java.io.IOException
public static TokenStream getTokenStream(TermPositionVector tpv)
public static TokenStream getTokenStream(TermPositionVector tpv, boolean tokenPositionsGuaranteedContiguous)
tpv
- tokenPositionsGuaranteedContiguous
- true if the token position numbers have no overlaps or gaps. If looking
to eek out the last drops of performance, set to true. If in doubt, set to false.public static TokenStream getTokenStream(IndexReader reader, int docId, java.lang.String field) throws java.io.IOException
java.io.IOException
public static TokenStream getTokenStream(IndexReader reader, int docId, java.lang.String field, Analyzer analyzer) throws java.io.IOException
java.io.IOException
public static TokenStream getTokenStream(Document doc, java.lang.String field, Analyzer analyzer)
public static TokenStream getTokenStream(java.lang.String field, java.lang.String contents, Analyzer analyzer)
Copyright © 2000-2018 Apache Software Foundation. All Rights Reserved.