Méthode | Description | |
---|---|---|
TokenizeString ( string inputText, bool returnFirstNgramOnly = false ) : List |
Simple whitespace tokenizer TODO: fix this to do filtering etc
|
Méthode | Description | |
---|---|---|
NormalizeQueryOrTitle ( string inputText ) : string |
Normalizes a query or title to the same format, with punctuation removed.
|
|
StripPunctuation ( string inputString ) : string |
Remove any punctuation (high-performance single pass method)
|
public static TokenizeString ( string inputText, bool returnFirstNgramOnly = false ) : List |
||
inputText | string | |
returnFirstNgramOnly | bool | |
Résultat | List |