C# Class Alsing.Text.Tokenizer

Show file Open project: vchelaru/FlatRedBall Class Usage Examples

Public Methods

Method Description
AddPattern ( IPatternMatcher matcher, bool caseSensitive, bool needsSeparators ) : Tokenizer
AddToken ( string token, bool caseSensitive, bool needsSeparators ) : Tokenizer
MakeImmutable ( ) : void
Tokenize ( ) : Alsing.Text.Token[]
Tokenizer ( ) : System

Private Methods

Method Description
ThrowIfImmutable ( ) : void

Method Details

AddPattern() public method

public AddPattern ( IPatternMatcher matcher, bool caseSensitive, bool needsSeparators ) : Tokenizer
matcher IPatternMatcher
caseSensitive bool
needsSeparators bool
return Tokenizer

AddToken() public method

public AddToken ( string token, bool caseSensitive, bool needsSeparators ) : Tokenizer
token string
caseSensitive bool
needsSeparators bool
return Tokenizer

MakeImmutable() public method

public MakeImmutable ( ) : void
return void

Tokenize() public method

public Tokenize ( ) : Alsing.Text.Token[]
return Alsing.Text.Token[]

Tokenizer() public method

public Tokenizer ( ) : System
return System