C# Class BalticAmadeus.FluentMdx.Lexer.Lexer

Represents a machine that performs lexical analysis based on regex-defined rules.
Inheritance: ILexer
Show file Open project: BalticAmadeus/FluentMdx

Public Methods

Method Description
Lexer ( ) : System

Initializes a new instance of Lexer and sets the lexical analysis rules.
Tokenize ( string source ) : IEnumerable

Transforms text into list of Token objects based on rules.

Method Details

Lexer() public method

Initializes a new instance of Lexer and sets the lexical analysis rules.
public Lexer ( ) : System
return System

Tokenize() public method

Transforms text into list of Token objects based on rules.
public Tokenize ( string source ) : IEnumerable
source string Text to tokenize.
return IEnumerable