Метод | Описание | |
---|---|---|
Tokenize ( ) : SimpleC.Types.Token[] | ||
Tokenizer ( string code ) : System |
Метод | Описание | |
---|---|---|
charTypeOf ( char c ) : CharType | ||
eof ( ) : bool |
Returns true if there are no more chars left.
|
|
next ( ) : char |
Returns the next character and advances the pointer.
|
|
nextType ( ) : CharType |
Returns the CharType of the next char, advancing the pointer.
|
|
peek ( ) : char |
Returns the next character without advancing the pointer.
|
|
peekType ( ) : CharType |
Returns the CharType of the next char, without advancing the pointer.
|
|
readToken ( StringBuilder builder, CharType typeToRead ) : void |
Reads characters into the StringBuilder while they match the given type(s).
|
|
skip ( CharType typeToSkip ) : void |
Skips any count of occurences of the given char class(es).
|
public Tokenize ( ) : SimpleC.Types.Token[] | ||
Результат | SimpleC.Types.Token[] |