C# Class NuGet.IndexingTests.TestSupport.TokenStreamExtensions

Datei anzeigen Open project: NuGet/NuGet.Services.Metadata

Public Methods

Method Description
Tokenize ( this tokenStream ) : IEnumerable
Tokenize ( this analyzer, string text ) : TokenAttributes[]

Method Details

Tokenize() public static method

public static Tokenize ( this tokenStream ) : IEnumerable
tokenStream this
return IEnumerable

Tokenize() public static method

public static Tokenize ( this analyzer, string text ) : TokenAttributes[]
analyzer this
text string
return TokenAttributes[]