Indicates whether
CommonToken.Text should be called after constructing tokens to explicitly set the text. This is useful for cases where the input stream might not be able to provide arbitrary substrings of text from the input after the lexer creates a token (e.g. the implementation of
ICharStream.GetText(Antlr4.Runtime.Misc.Interval) in
UnbufferedCharStream throws an
System.NotSupportedException ). Explicitly setting the token text allows
IToken.Text() to be called at any time regardless of the input stream implementation.
The default value is to avoid the performance and memory overhead of copying text for every token unless explicitly requested.
