C# Class Microsoft.Scripting.Runtime.TokenizerBuffer

显示文件 Open project: jschementi/iron Class Usage Examples

Public Methods

Method Description
Back ( ) : void
DiscardToken ( ) : void

Marks token start. It means the buffer can drop the current token. Can be called even if no token has been read yet.

GetChar ( int offset ) : char
GetCharRelative ( int disp ) : char
GetTokenSubstring ( int offset ) : string
GetTokenSubstring ( int offset, int length ) : string
Initialize ( TextReader reader, SourceLocation initialLocation, int initialCapacity, bool multiEolns ) : void
IsEoln ( int current ) : bool
MarkMultiLineTokenEnd ( ) : void

Marks token end. Enables to read the current token.

MarkMultiLineTokenEnd ( int disp ) : void
MarkSingleLineTokenEnd ( ) : void
MarkSingleLineTokenEnd ( int disp ) : void
MarkTokenEnd ( bool isMultiLine ) : void
Peek ( ) : int
Read ( int ch ) : bool
Read ( string str ) : bool
Read ( ) : int
ReadEolnOpt ( int current ) : int
ReadLine ( ) : int

Reads till the end of line and returns the character that stopped the reading. The returned character is not skipped.

Seek ( int offset ) : void

Sets the current position inside current token or one character behind it.

SeekRelative ( int disp ) : void

Sets the current position inside current token or one character behind it. A relative displacement with respect to the current position in the token is specified.

TokenizerBuffer ( TextReader reader, SourceLocation initialLocation, int initialCapacity, bool multiEolns ) : System

Private Methods

Method Description
CheckInvariants ( ) : void
ClearInvalidChars ( ) : void
DumpToken ( ) : void
GetTokenEndMultiEolns ( ) : SourceLocation
GetTokenEndSingleEoln ( ) : SourceLocation
GetTokenString ( ) : string
RefillBuffer ( ) : void
ResizeInternal ( char &array, int newSize, int start, int count ) : void

Resizes an array to a speficied new size and copies a portion of the original array into its beginning.

Method Details

Back() public method

public Back ( ) : void
return void

DiscardToken() public method

Marks token start. It means the buffer can drop the current token. Can be called even if no token has been read yet.
public DiscardToken ( ) : void
return void

GetChar() public method

public GetChar ( int offset ) : char
offset int
return char

GetCharRelative() public method

public GetCharRelative ( int disp ) : char
disp int
return char

GetTokenSubstring() public method

public GetTokenSubstring ( int offset ) : string
offset int
return string

GetTokenSubstring() public method

public GetTokenSubstring ( int offset, int length ) : string
offset int
length int
return string

Initialize() public method

public Initialize ( TextReader reader, SourceLocation initialLocation, int initialCapacity, bool multiEolns ) : void
reader System.IO.TextReader
initialLocation SourceLocation
initialCapacity int
multiEolns bool
return void

IsEoln() public method

public IsEoln ( int current ) : bool
current int
return bool

MarkMultiLineTokenEnd() public method

Marks token end. Enables to read the current token.
public MarkMultiLineTokenEnd ( ) : void
return void

MarkMultiLineTokenEnd() public method

public MarkMultiLineTokenEnd ( int disp ) : void
disp int
return void

MarkSingleLineTokenEnd() public method

public MarkSingleLineTokenEnd ( ) : void
return void

MarkSingleLineTokenEnd() public method

public MarkSingleLineTokenEnd ( int disp ) : void
disp int
return void

MarkTokenEnd() public method

public MarkTokenEnd ( bool isMultiLine ) : void
isMultiLine bool
return void

Peek() public method

public Peek ( ) : int
return int

Read() public method

public Read ( int ch ) : bool
ch int
return bool

Read() public method

public Read ( string str ) : bool
str string
return bool

Read() public method

public Read ( ) : int
return int

ReadEolnOpt() public method

public ReadEolnOpt ( int current ) : int
current int
return int

ReadLine() public method

Reads till the end of line and returns the character that stopped the reading. The returned character is not skipped.
public ReadLine ( ) : int
return int

Seek() public method

Sets the current position inside current token or one character behind it.
public Seek ( int offset ) : void
offset int
return void

SeekRelative() public method

Sets the current position inside current token or one character behind it. A relative displacement with respect to the current position in the token is specified.
public SeekRelative ( int disp ) : void
disp int
return void

TokenizerBuffer() public method

public TokenizerBuffer ( TextReader reader, SourceLocation initialLocation, int initialCapacity, bool multiEolns ) : System
reader TextReader
initialLocation SourceLocation
initialCapacity int
multiEolns bool
return System