C# 클래스 Lucene.Net.Analysis.Core.WhitespaceTokenizer

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

You must specify the required LuceneVersion compatibility when creating WhitespaceTokenizer:

  • As of 3.1, CharTokenizer uses an int based API to normalize and detect token characters. See CharTokenizer#isTokenChar(int) and CharTokenizer#normalize(int) for details.

상속: Lucene.Net.Analysis.Util.CharTokenizer
파일 보기 프로젝트 열기: apache/lucenenet 1 사용 예제들

공개 메소드들

메소드 설명
WhitespaceTokenizer ( LuceneVersion matchVersion, AttributeFactory factory, TextReader @in ) : System.IO

Construct a new WhitespaceTokenizer using a given org.apache.lucene.util.AttributeSource.AttributeFactory. @param matchVersion Lucene version to match See above
WhitespaceTokenizer ( LuceneVersion matchVersion, TextReader @in ) : System.IO

보호된 메소드들

메소드 설명
IsTokenChar ( int c ) : bool

Collects only characters which do not satisfy Character#isWhitespace(int).

메소드 상세

IsTokenChar() 보호된 메소드

Collects only characters which do not satisfy Character#isWhitespace(int).
protected IsTokenChar ( int c ) : bool
c int
리턴 bool

WhitespaceTokenizer() 공개 메소드

Construct a new WhitespaceTokenizer using a given org.apache.lucene.util.AttributeSource.AttributeFactory. @param matchVersion Lucene version to match See above
public WhitespaceTokenizer ( LuceneVersion matchVersion, AttributeFactory factory, TextReader @in ) : System.IO
matchVersion LuceneVersion
factory AttributeFactory /// the attribute factory to use for this
@in System.IO.TextReader
리턴 System.IO

WhitespaceTokenizer() 공개 메소드

public WhitespaceTokenizer ( LuceneVersion matchVersion, TextReader @in ) : System.IO
matchVersion LuceneVersion Lucene version /// to match See above"/> ///
@in System.IO.TextReader
리턴 System.IO