C# 클래스 Lucene.Net.Analysis.Tokenizer

A Tokenizer is a TokenStream whose input is a Reader.

this is an abstract class; subclasses must override #IncrementToken()

NOTE: Subclasses overriding #IncrementToken() must call AttributeSource#ClearAttributes() before setting attributes.

상속: TokenStream

보호된 프로퍼티들

프로퍼티	타입	설명
input	System.IO.TextReader

메소드	설명
Dispose ( ) : void	{@inheritDoc} NOTE: The default implementation closes the input Reader, so be sure to call `super.close()` when overriding this method.
Reset ( ) : void

메소드	설명
CorrectOffset ( int currentOff ) : int	Return the corrected offset. If #input is a CharFilter subclass this method calls CharFilter#correctOffset, else returns `currentOff`.
Tokenizer ( AttributeFactory factory, TextReader input ) : System	Construct a token stream processing the given input using the given AttributeFactory.
Tokenizer ( TextReader input ) : System	Construct a token stream processing the given input.

메소드	설명
SetReaderTestPoint ( ) : bool

Return the corrected offset. If #input is a CharFilter subclass this method calls CharFilter#correctOffset, else returns currentOff.

protected CorrectOffset ( int currentOff ) : int
currentOff	int	offset as seen in the output
리턴	int

{@inheritDoc}

NOTE: The default implementation closes the input Reader, so be sure to call super.close() when overriding this method.

public Dispose ( ) : void
리턴	void

public Reset ( ) : void
리턴	void

Construct a token stream processing the given input using the given AttributeFactory.

protected Tokenizer ( AttributeFactory factory, TextReader input ) : System
factory	AttributeFactory
input	System.IO.TextReader
리턴	System

Construct a token stream processing the given input.

protected Tokenizer ( TextReader input ) : System
input	System.IO.TextReader
리턴	System

The text source for this Tokenizer.

protected TextReader,System.IO input
리턴	System.IO.TextReader