• 홈
• SimpleC
• Lexing
• Tokenizer

C# 클래스 SimpleC.Lexing.Tokenizer

파일 보기 프로젝트 열기: nrother/simple-c 1 사용 예제들

공개 메소드들

메소드	설명
Tokenize ( ) : SimpleC.Types.Token[]
Tokenizer ( string code ) : System

비공개 메소드들

메소드	설명
charTypeOf ( char c ) : CharType
eof ( ) : bool	Returns true if there are no more chars left.
next ( ) : char	Returns the next character and advances the pointer.
nextType ( ) : CharType	Returns the CharType of the next char, advancing the pointer.
peek ( ) : char	Returns the next character without advancing the pointer.
peekType ( ) : CharType	Returns the CharType of the next char, without advancing the pointer.
readToken ( StringBuilder builder, CharType typeToRead ) : void	Reads characters into the StringBuilder while they match the given type(s).
skip ( CharType typeToSkip ) : void	Skips any count of occurences of the given char class(es).

메소드 상세