C# Class ProgrammingLanguageNr1.Tokenizer

Show file Open project: eriksvedang/Sprak Class Usage Examples

Public Methods

Method	Description
Tokenizer ( ProgrammingLanguageNr1.ErrorHandler errorHandler, bool stripOutComments ) : System
process ( TextReader textReader ) : List

Private Methods

Method	Description
ASSIGNMENT ( ) : Token
BRACKET_LEFT ( ) : Token
BRACKET_RIGHT ( ) : Token
COMMA ( ) : Token
COMMENT ( ) : Token
DOT ( ) : Token
NAME ( ) : Token
NEW_LINE ( ) : Token
NOT ( ) : Token
NUMBER ( bool negative ) : Token
OPERATOR ( ) : Token
PARANTHESIS_LEFT ( ) : Token
PARANTHESIS_RIGHT ( ) : Token
QUOTED_STRING ( bool pDoubleQuoted ) : Token
isDIGIT ( ) : bool
isLETTER ( ) : bool
readNextChar ( ) : void
readNextToken ( ) : Token
stripComment ( ) : void

Method Details

Tokenizer() public method

public Tokenizer ( ProgrammingLanguageNr1.ErrorHandler errorHandler, bool stripOutComments ) : System
errorHandler	ProgrammingLanguageNr1.ErrorHandler
stripOutComments	bool
return	System

process() public method

public process ( TextReader textReader ) : List
textReader	TextReader
return	List