• Home
• Lucene
• Net
• Analysis
• Wikipedia
• WikipediaTokenizerImpl

C# Class Lucene.Net.Analysis.Wikipedia.WikipediaTokenizerImpl

Show file Open project: apache/lucenenet Class Usage Examples

Public Properties

Property	Type	Description
ACRONYM	int
ALPHANUM	int
APOSTROPHE	int
BOLD	int
BOLD_ITALICS	int
CATEGORY	int
CATEGORY_STATE	int
CITATION	int
CJ	int
COMPANY	int
DOUBLE_BRACE_STATE	int
DOUBLE_EQUALS_STATE	int
EMAIL	int
EXTERNAL_LINK	int
EXTERNAL_LINK_STATE	int
EXTERNAL_LINK_URL	int
FIVE_SINGLE_QUOTES_STATE	int
HEADING	int
HOST	int
INTERNAL_LINK	int
INTERNAL_LINK_STATE	int
ITALICS	int
NUM	int
STRING	int
SUB_HEADING	int
THREE_SINGLE_QUOTES_STATE	int
TOKEN_TYPES	string[]
TWO_SINGLE_QUOTES_STATE	int
YYEOF	int
YYINITIAL	int

Public Methods

Method	Description
GetNextToken ( ) : int
YyBegin ( int newState ) : void
YyCharAt ( int pos ) : char
YyClose ( ) : void
YyPushBack ( int number ) : void
YyReset ( TextReader reader ) : void

Private Methods

Method	Description
GetText ( ICharTermAttribute t ) : void
SetText ( StringBuilder buffer ) : int
WikipediaTokenizerImpl ( TextReader @in ) : Lucene.Net.Analysis.Tokenattributes
ZzRefill ( ) : bool
ZzScanError ( int errorCode ) : void
ZzUnpackAction ( string packed, int offset, int result ) : int
ZzUnpackAction ( ) : int[]
ZzUnpackAttribute ( string packed, int offset, int result ) : int
ZzUnpackAttribute ( ) : int[]
ZzUnpackCMap ( string packed ) : char[]
ZzUnpackRowMap ( string packed, int offset, int result ) : int
ZzUnpackRowMap ( ) : int[]
ZzUnpackTrans ( string packed, int offset, int result ) : int
ZzUnpackTrans ( ) : int[]
reset ( ) : void

Method Details

Property Details