C# Class Bamboo.Prevalence.Indexing.FullText.Tokenizers.StringTokenizer

Inheritance: ITokenizer
Afficher le fichier Open project: bamboo/Bamboo.Prevalence Class Usage Examples

Méthodes publiques

Méthode Description
Clone ( ITokenizer tail ) : ITokenizer

Returns a clone.
NextToken ( ) : Token

See Bamboo.Prevalence.Indexing.FullText.ITokenizer.NextToken for details.
StringTokenizer ( string text ) : System

Creates a new tokenizer for the string in the text argument.

Méthodes protégées

Méthode Description
StringTokenizer ( string text, int current ) : System

Creates a new tokenizer for the string in the text argument starting from the position indicated by the current argument.

Private Methods

Méthode Description
IsSeparator ( string text, int index ) : bool
SkipSeparators ( ) : void

Method Details

Clone() public méthode

Returns a clone.
public Clone ( ITokenizer tail ) : ITokenizer
tail ITokenizer must always be null
Résultat ITokenizer

NextToken() public méthode

See Bamboo.Prevalence.Indexing.FullText.ITokenizer.NextToken for details.
public NextToken ( ) : Token
Résultat Bamboo.Prevalence.Indexing.FullText.Token

StringTokenizer() public méthode

Creates a new tokenizer for the string in the text argument.
public StringTokenizer ( string text ) : System
text string token source
Résultat System

StringTokenizer() protected méthode

Creates a new tokenizer for the string in the text argument starting from the position indicated by the current argument.
protected StringTokenizer ( string text, int current ) : System
text string token source
current int starting position
Résultat System