Méthode | Description | |
---|---|---|
Lexer ( ) : System |
Initializes a new instance of Lexer and sets the lexical analysis rules.
|
|
Tokenize ( string source ) : IEnumerable |
Transforms text into list of Token objects based on rules.
|
public Tokenize ( string source ) : IEnumerable |
||
source | string | Text to tokenize. |
Résultat | IEnumerable |