Class CodepointCountFilter
- java.lang.Object
-
- org.apache.lucene.util.AttributeSource
-
- org.apache.lucene.analysis.TokenStream
-
- org.apache.lucene.analysis.TokenFilter
-
- org.apache.lucene.analysis.FilteringTokenFilter
-
- org.apache.lucene.analysis.miscellaneous.CodepointCountFilter
-
- All Implemented Interfaces:
Closeable,AutoCloseable,Unwrappable<TokenStream>
public final class CodepointCountFilter extends FilteringTokenFilter
Removes words that are too long or too short from the stream.Note: Length is calculated as the number of Unicode codepoints.
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
AttributeSource.State
-
-
Field Summary
-
Fields inherited from class org.apache.lucene.analysis.TokenFilter
input
-
Fields inherited from class org.apache.lucene.analysis.TokenStream
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
-
-
Constructor Summary
Constructors Constructor Description CodepointCountFilter(TokenStream in, int min, int max)Create a newCodepointCountFilter.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description booleanaccept()-
Methods inherited from class org.apache.lucene.analysis.FilteringTokenFilter
end, incrementToken, reset
-
Methods inherited from class org.apache.lucene.analysis.TokenFilter
close, unwrap
-
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString
-
-
-
-
Constructor Detail
-
CodepointCountFilter
public CodepointCountFilter(TokenStream in, int min, int max)
Create a newCodepointCountFilter. This will filter out tokens whoseCharTermAttributeis either too short (Character.codePointCount(char[], int, int)< min) or too long (Character.codePointCount(char[], int, int)> max).- Parameters:
in- theTokenStreamto consumemin- the minimum lengthmax- the maximum length
-
-
Method Detail
-
accept
public boolean accept()
- Specified by:
acceptin classFilteringTokenFilter
-
-