C# Class Microsoft.Languages.Core.Tokens.Tokenizer

Exibir arquivo Open project: Microsoft/RTVS

Public Methods

Method	Description
HandleEolComment ( CharacterStream cs, int>.Action addToken ) : void	Handle generic comment. Comment goes to the end of the line.
HandleString ( char openQuote, CharacterStream cs, int>.Action addToken ) : void	Handles string sequence with escapes
SkipIdentifier ( CharacterStream cs, bool>.Func isIdentifierLeadCharacter, bool>.Func isIdentifierCharacter ) : void

Method Details

HandleEolComment() public static method

Handle generic comment. Comment goes to the end of the line.

public static HandleEolComment ( CharacterStream cs, int>.Action addToken ) : void
cs	Microsoft.Languages.Core.Text.CharacterStream
addToken	int>.Action
return	void

HandleString() public static method

Handles string sequence with escapes

public static HandleString ( char openQuote, CharacterStream cs, int>.Action addToken ) : void
openQuote	char
cs	Microsoft.Languages.Core.Text.CharacterStream
addToken	int>.Action
return	void

SkipIdentifier() public static method

public static SkipIdentifier ( CharacterStream cs, bool>.Func isIdentifierLeadCharacter, bool>.Func isIdentifierCharacter ) : void
cs	Microsoft.Languages.Core.Text.CharacterStream
isIdentifierLeadCharacter	bool>.Func
isIdentifierCharacter	bool>.Func
return	void