C# Class BibtexLibrary.Tokenizer.Tokenizer

Mostra file Open project: MaikelH/BibtexLibrary Class Usage Examples

Public Methods

Method	Description
GetAllTokens ( ) : ICollection	Return all the tokens in the inputstring.
GetPreviousCharacters ( int n ) : string	Returns the previous n characters.
NextToken ( ) : AbstractToken
Peek ( ) : AbstractToken
Tokenizer ( ExpressionDictionary dictionary, string input ) : System

Method Details

GetAllTokens() public method

Return all the tokens in the inputstring.

public GetAllTokens ( ) : ICollection
return	ICollection

GetPreviousCharacters() public method

Returns the previous n characters.

public GetPreviousCharacters ( int n ) : string
n	int
return	string

NextToken() public method

public NextToken ( ) : AbstractToken
return	AbstractToken

Peek() public method

public Peek ( ) : AbstractToken
return	AbstractToken

Tokenizer() public method

public Tokenizer ( ExpressionDictionary dictionary, string input ) : System
dictionary	ExpressionDictionary
input	string
return	System