Package org.apache.lucene.analysis.th
Class ThaiWordFilter
- java.lang.Object
-
- org.apache.lucene.util.AttributeSource
-
- org.apache.lucene.analysis.TokenStream
-
- org.apache.lucene.analysis.TokenFilter
-
- org.apache.lucene.analysis.th.ThaiWordFilter
-
- All Implemented Interfaces:
Closeable
,AutoCloseable
public final class ThaiWordFilter extends org.apache.lucene.analysis.TokenFilter
TokenFilter
that useBreakIterator
to break each Token that is Thai into separate Token(s) for each Thai word.Please note: Since matchVersion 3.1 on, this filter no longer lowercases non-thai text.
ThaiAnalyzer
will insert aLowerCaseFilter
before this filter so the behaviour of the Analyzer does not change. With version 3.1, the filter handles position increments correctly.WARNING: this filter may not be supported by all JREs. It is known to work with Sun/Oracle and Harmony JREs. If your application needs to be fully portable, consider using ICUTokenizer instead, which uses an ICU Thai BreakIterator that will always be available.
-
-
Field Summary
Fields Modifier and Type Field Description static boolean
DBBI_AVAILABLE
True if the JRE supports a working dictionary-based breakiterator for Thai.
-
Constructor Summary
Constructors Constructor Description ThaiWordFilter(org.apache.lucene.analysis.TokenStream input)
Deprecated.Use the ctor withmatchVersion
instead!ThaiWordFilter(org.apache.lucene.util.Version matchVersion, org.apache.lucene.analysis.TokenStream input)
Creates a new ThaiWordFilter with the specified match version.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
incrementToken()
void
reset()
-
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
-
-
-
-
Constructor Detail
-
ThaiWordFilter
@Deprecated public ThaiWordFilter(org.apache.lucene.analysis.TokenStream input)
Deprecated.Use the ctor withmatchVersion
instead!Creates a new ThaiWordFilter that also lowercases non-thai text.
-
ThaiWordFilter
public ThaiWordFilter(org.apache.lucene.util.Version matchVersion, org.apache.lucene.analysis.TokenStream input)
Creates a new ThaiWordFilter with the specified match version.
-
-
Method Detail
-
incrementToken
public boolean incrementToken() throws IOException
- Specified by:
incrementToken
in classorg.apache.lucene.analysis.TokenStream
- Throws:
IOException
-
reset
public void reset() throws IOException
- Overrides:
reset
in classorg.apache.lucene.analysis.TokenFilter
- Throws:
IOException
-
-