메소드 | 설명 | |
---|---|---|
Back ( ) : void | ||
DiscardToken ( ) : void |
Marks token start. It means the buffer can drop the current token. Can be called even if no token has been read yet.
|
|
GetChar ( int offset ) : char | ||
GetCharRelative ( int disp ) : char | ||
GetTokenSubstring ( int offset ) : string | ||
GetTokenSubstring ( int offset, int length ) : string | ||
Initialize ( |
||
IsEoln ( int current ) : bool | ||
MarkMultiLineTokenEnd ( ) : void |
Marks token end. Enables to read the current token.
|
|
MarkMultiLineTokenEnd ( int disp ) : void | ||
MarkSingleLineTokenEnd ( ) : void | ||
MarkSingleLineTokenEnd ( int disp ) : void | ||
MarkTokenEnd ( bool isMultiLine ) : void | ||
Peek ( ) : int | ||
Read ( int ch ) : bool | ||
Read ( string str ) : bool | ||
Read ( ) : int | ||
ReadEolnOpt ( int current ) : int | ||
ReadLine ( ) : int |
Reads till the end of line and returns the character that stopped the reading. The returned character is not skipped.
|
|
Seek ( int offset ) : void |
Sets the current position inside current token or one character behind it.
|
|
SeekRelative ( int disp ) : void |
Sets the current position inside current token or one character behind it. A relative displacement with respect to the current position in the token is specified.
|
|
TokenizerBuffer ( TextReader reader, SourceLocation initialLocation, int initialCapacity, bool multiEolns ) : System |
메소드 | 설명 | |
---|---|---|
CheckInvariants ( ) : void | ||
ClearInvalidChars ( ) : void | ||
DumpToken ( ) : void | ||
GetTokenEndMultiEolns ( ) : SourceLocation | ||
GetTokenEndSingleEoln ( ) : SourceLocation | ||
GetTokenString ( ) : string | ||
RefillBuffer ( ) : void | ||
ResizeInternal ( char &array, int newSize, int start, int count ) : void |
Resizes an array to a speficied new size and copies a portion of the original array into its beginning.
|
public GetTokenSubstring ( int offset, int length ) : string | ||
offset | int | |
length | int | |
리턴 | string |
public Initialize ( |
||
reader | ||
initialLocation | SourceLocation | |
initialCapacity | int | |
multiEolns | bool | |
리턴 | void |
public TokenizerBuffer ( TextReader reader, SourceLocation initialLocation, int initialCapacity, bool multiEolns ) : System | ||
reader | TextReader | |
initialLocation | SourceLocation | |
initialCapacity | int | |
multiEolns | bool | |
리턴 | System |