C# Class Pytocs.Syntax.Lexer

Lexer for Python.

Exibir arquivo Open project: uxmal/pytocs Class Usage Examples

Public Methods

Method	Description
Get ( ) : Token
Lexer ( string filename, TextReader rdr ) : System
Peek ( ) : Token

Private Methods

Method	Description
Accum ( char ch, State st ) : void
AccumString ( int c, State st ) : void
Advance ( ) : void
CreateStringLiteral ( bool longLiteral ) : Exp
EatChToken ( TokenType t, object value = null ) : Token
GetToken ( ) : Token
Invalid ( int c, char ch ) : FormatException
IsLogicalNewLine ( ) : bool
LookupId ( ) : Token
Newline ( ) : Token
Real ( ) : Token
Token ( TokenType t ) : Token
Token ( TokenType t, State newState ) : Token
Token ( TokenType t, object value ) : Token
Token ( TokenType t, object value, State newState ) : Token
Transition ( State s ) : void

Method Details

Get() public method

public Get ( ) : Token
return	Token

Lexer() public method

public Lexer ( string filename, TextReader rdr ) : System
filename	string
rdr	TextReader
return	System

Peek() public method

public Peek ( ) : Token
return	Token