C# Class ProgrammingLanguageNr1.Tokenizer

Show file Open project: eriksvedang/Sprak Class Usage Examples

Public Methods

Method Description
Tokenizer ( ProgrammingLanguageNr1.ErrorHandler errorHandler, bool stripOutComments ) : System
process ( TextReader textReader ) : List

Private Methods

Method Description
ASSIGNMENT ( ) : Token
BRACKET_LEFT ( ) : Token
BRACKET_RIGHT ( ) : Token
COMMA ( ) : Token
COMMENT ( ) : Token
DOT ( ) : Token
NAME ( ) : Token
NEW_LINE ( ) : Token
NOT ( ) : Token
NUMBER ( bool negative ) : Token
OPERATOR ( ) : Token
PARANTHESIS_LEFT ( ) : Token
PARANTHESIS_RIGHT ( ) : Token
QUOTED_STRING ( bool pDoubleQuoted ) : Token
isDIGIT ( ) : bool
isLETTER ( ) : bool
readNextChar ( ) : void
readNextToken ( ) : Token
stripComment ( ) : void

Method Details

Tokenizer() public method

public Tokenizer ( ProgrammingLanguageNr1.ErrorHandler errorHandler, bool stripOutComments ) : System
errorHandler ProgrammingLanguageNr1.ErrorHandler
stripOutComments bool
return System

process() public method

public process ( TextReader textReader ) : List
textReader TextReader
return List