| Token |
A token is a category of lexemes. Some tokens are keywords like "MODULE". Some tokens are symbols; the token of type PLUS is the symbol "+". Some tokens are a large set; some tokens of type INTEGER are "73" and "255". The enumerations below include all the tokens that we need to recognize. Note that the Modula-2 User's Manual offers both # and <> to mean NOT EQUAL (pp. 96, 97, and 110). Our code does not use #. We only use <>. Many errors are reported by TOKENTYPE which is just a number (like 34 for T_ID). Therefore, I added enumeration numbers for tokens in the left column as a convenience during debugging. Author: Tom Fuller Date: January 6, 2007 |