C# Class Jurassic.Compiler.Lexer

Cleans up any resources used by the lexer.

Creates a Lexer instance with the given source of text.

Reads the next token from the reader.

Reads a string literal.

Determines if the given character is valid in a hexidecimal number.

Determines if the given character is valid as a character of an identifier.

Determines if the given character is valid as the first character of an identifier.

Determines if the given character is a line terminator.

Determines if the given character is valid as the first character of a numeric literal.

Determines if the given character is valid as the first character of a punctuator.

Determines if the given character is valid as the first character of a string literal.

Determines if the given character is whitespace.

Reads a divide operator ('/' or '/='), a comment ('//' or '/*'), or a regular expression literal.

Reads an extended unicode escape sequence in the form "\u{20BB7}".

Reads a hexidecimal number with the given number of digits and turns it into a character.

Reads an identifier token.

Reads an integer value.

Reads a line terminator (a newline).

Reads past a multi-line comment.

Reads the next character from the input stream.

Reads a numeric literal token.

Reads an octal number turns it into a single-byte character.

Reads a punctuation token.

Reads a regular expression literal.

Reads past a single line comment.

Reads past whitespace.