C# Class Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31

Inheritance: IStandardTokenizerInterface
Afficher le fichier Open project: apache/lucenenet

Méthodes publiques

Свойство Type Description
EMAIL_TYPE int
HANGUL_TYPE int
HIRAGANA_TYPE int
IDEOGRAPHIC_TYPE int
KATAKANA_TYPE int
NUMERIC_TYPE int
SOUTH_EAST_ASIAN_TYPE int
URL_TYPE int
WORD_TYPE int
YYEOF int

Méthodes publiques

Méthode Description
GetNextToken ( ) : int

Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.
GetText ( ICharTermAttribute t ) : void

Fills CharTermAttribute with the current token text.
UAX29URLEmailTokenizerImpl31 ( TextReader @in ) : Lucene.Net.Analysis.Tokenattributes

Creates a new scanner
YyBegin ( int newState ) : void

Enters a new lexical state
YyCharAt ( int pos ) : char

Returns the character at position pos from the matched text. It is equivalent to YyText().charAt(pos), but faster
YyClose ( ) : void

Closes the input stream.
YyPushBack ( int number ) : void

Pushes the specified amount of characters back into the input stream. They will be read again by then next call of the scanning method
YyReset ( TextReader reader ) : void

Resets the scanner to read from a new input stream. Does not close the old reader. All internal variables are reset, the old input stream cannot be reused (internal buffer is discarded and lost). Lexical state is set to ZZ_INITIAL. Internal scan buffer is resized down to its initial length, if it has grown.

Private Methods

Méthode Description
ZzRefill ( ) : bool

Refills the input buffer.
ZzScanError ( int errorCode ) : void

Reports an error that occured while scanning. In a wellformed scanner (no or only correct usage of YyPushBack(int) and a match-all fallback rule) this method will only be called with things that "Can't Possibly Happen". If this method is called, something is seriously wrong (e.g. a JFlex bug producing a faulty scanner etc.). Usual syntax/scanner level error handling should be done in error fallback rules.
ZzUnpackAction ( string packed, int offset, int result ) : int
ZzUnpackAction ( ) : int[]
ZzUnpackAttribute ( string packed, int offset, int result ) : int
ZzUnpackAttribute ( ) : int[]
ZzUnpackCMap ( string packed ) : char[]

Unpacks the compressed character translation table.
ZzUnpackRowMap ( string packed, int offset, int result ) : int
ZzUnpackRowMap ( ) : int[]
ZzUnpackTrans ( string packed, int offset, int result ) : int
ZzUnpackTrans ( ) : int[]

Method Details

GetNextToken() public méthode

Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.
if any I/O-Error occurs
public GetNextToken ( ) : int
Résultat int

GetText() public méthode

Fills CharTermAttribute with the current token text.
public GetText ( ICharTermAttribute t ) : void
t ICharTermAttribute
Résultat void

UAX29URLEmailTokenizerImpl31() public méthode

Creates a new scanner
public UAX29URLEmailTokenizerImpl31 ( TextReader @in ) : Lucene.Net.Analysis.Tokenattributes
@in System.IO.TextReader
Résultat Lucene.Net.Analysis.Tokenattributes

YyBegin() public méthode

Enters a new lexical state
public YyBegin ( int newState ) : void
newState int the new lexical state
Résultat void

YyCharAt() public méthode

Returns the character at position pos from the matched text. It is equivalent to YyText().charAt(pos), but faster
public YyCharAt ( int pos ) : char
pos int the position of the character to fetch. /// A value from 0 to YyLength()-1.
Résultat char

YyClose() public méthode

Closes the input stream.
public YyClose ( ) : void
Résultat void

YyPushBack() public méthode

Pushes the specified amount of characters back into the input stream. They will be read again by then next call of the scanning method
public YyPushBack ( int number ) : void
number int the number of characters to be read again. /// This number must not be greater than YyLength()!
Résultat void

YyReset() public méthode

Resets the scanner to read from a new input stream. Does not close the old reader. All internal variables are reset, the old input stream cannot be reused (internal buffer is discarded and lost). Lexical state is set to ZZ_INITIAL. Internal scan buffer is resized down to its initial length, if it has grown.
public YyReset ( TextReader reader ) : void
reader System.IO.TextReader the new input stream
Résultat void

Property Details

EMAIL_TYPE public_oe static_oe property

public static int EMAIL_TYPE
Résultat int

HANGUL_TYPE public_oe static_oe property

public static int HANGUL_TYPE
Résultat int

HIRAGANA_TYPE public_oe static_oe property

public static int HIRAGANA_TYPE
Résultat int

IDEOGRAPHIC_TYPE public_oe static_oe property

public static int IDEOGRAPHIC_TYPE
Résultat int

KATAKANA_TYPE public_oe static_oe property

public static int KATAKANA_TYPE
Résultat int

NUMERIC_TYPE public_oe static_oe property

public static int NUMERIC_TYPE
Résultat int

SOUTH_EAST_ASIAN_TYPE public_oe static_oe property

public static int SOUTH_EAST_ASIAN_TYPE
Résultat int

URL_TYPE public_oe static_oe property

public static int URL_TYPE
Résultat int

WORD_TYPE public_oe static_oe property

public static int WORD_TYPE
Résultat int

YYEOF public_oe static_oe property

This character denotes the end of file
public static int YYEOF
Résultat int