Method | Description | |
---|---|---|
ScanAll ( ) : TokenList | ||
SetText ( string text ) : void | ||
Tokenize ( string text ) : TokenList |
Method | Description | |
---|---|---|
IsOperator ( char ch ) : bool | ||
ScanComment ( |
||
ScanMultilineComment ( |
||
ScanOne ( |
||
ScanOperator ( |
||
ScanOperatorSpecific ( |
||
ScanQuotedString ( |
||
ScanString ( |
||
UpdateNewlineStats ( char ch ) : void |
public static Tokenize ( string text ) : TokenList | ||
text | string | |
return | TokenList |