C# Class ilcclib.Tokenizer.CTokenizer

显示文件 Open project: soywiz/ilcc Class Usage Examples

Private Properties

Property	Type	Description
CountLinesBetween	void

Public Methods

Method	Description
CTokenizer ( string Text, bool TokenizeSpaces = false ) : System
GetTokenPositionAtCurrentPos ( ) : CTokenPosition
ReadNext ( ) : CToken
ReadUntilSequence ( string Sequence ) : string
SkipUntilSequence ( string Sequence ) : int
Tokenize ( ) : IEnumerable

Private Methods

Method	Description
CountLinesBetween ( int Start, int End ) : void

Method Details

CTokenizer() public method

public CTokenizer ( string Text, bool TokenizeSpaces = false ) : System
Text	string
TokenizeSpaces	bool
return	System

GetTokenPositionAtCurrentPos() public method

public GetTokenPositionAtCurrentPos ( ) : CTokenPosition
return	CTokenPosition

ReadNext() public method

public ReadNext ( ) : CToken
return	CToken

ReadUntilSequence() public method

public ReadUntilSequence ( string Sequence ) : string
Sequence	string
return	string

SkipUntilSequence() public method

public SkipUntilSequence ( string Sequence ) : int
Sequence	string
return	int

Tokenize() public method

public Tokenize ( ) : IEnumerable
return	IEnumerable