C# Class Axiom.Scripting.Compiler.Parser.ScriptLexer

Exibir arquivo Open project: WolfgangSt/axiom Class Usage Examples

Public Methods

Method	Description
ScriptLexer ( ) : System
Tokenize ( String str, String source ) : IList	Tokenizes the given input and returns the list of tokens found

Private Methods

Method	Description
IsNewline ( char c ) : bool
IsWhitespace ( char c ) : bool
SetToken ( StringBuilder lexeme, uint line, String source, List tokens ) : void

Method Details

ScriptLexer() public method

public ScriptLexer ( ) : System
return	System

Tokenize() public method

Tokenizes the given input and returns the list of tokens found

public Tokenize ( String str, String source ) : IList
str	String
source	String
return	IList