C# Class Lucene.Net.Analysis.Miscellaneous.ASCIIFoldingFilter

This class converts alphabetic, numeric, and symbolic Unicode characters which are not in the first 127 ASCII characters (the "Basic Latin" Unicode block) into their ASCII equivalents, if one exists. Characters from the following Unicode blocks are converted; however, only those characters with reasonable ASCII alternatives are converted:

C1 Controls and Latin-1 Supplement: http://www.unicode.org/charts/PDF/U0080.pdf
Latin Extended-A: http://www.unicode.org/charts/PDF/U0100.pdf
Latin Extended-B: http://www.unicode.org/charts/PDF/U0180.pdf
Latin Extended Additional: http://www.unicode.org/charts/PDF/U1E00.pdf
Latin Extended-C: http://www.unicode.org/charts/PDF/U2C60.pdf
Latin Extended-D: http://www.unicode.org/charts/PDF/UA720.pdf
IPA Extensions: http://www.unicode.org/charts/PDF/U0250.pdf
Phonetic Extensions: http://www.unicode.org/charts/PDF/U1D00.pdf
Phonetic Extensions Supplement: http://www.unicode.org/charts/PDF/U1D80.pdf
General Punctuation: http://www.unicode.org/charts/PDF/U2000.pdf
Superscripts and Subscripts: http://www.unicode.org/charts/PDF/U2070.pdf
Enclosed Alphanumerics: http://www.unicode.org/charts/PDF/U2460.pdf
Dingbats: http://www.unicode.org/charts/PDF/U2700.pdf
Supplemental Punctuation: http://www.unicode.org/charts/PDF/U2E00.pdf
Alphabetic Presentation Forms: http://www.unicode.org/charts/PDF/UFB00.pdf
Halfwidth and Fullwidth Forms: http://www.unicode.org/charts/PDF/UFF00.pdf

See: http://en.wikipedia.org/wiki/Latin_characters_in_Unicode For example, 'à' will be replaced by 'a'.

Inheritance: TokenFilter

Show file Open project: apache/lucenenet Class Usage Examples

Public Methods

Method	Description
ASCIIFoldingFilter ( TokenStream input ) : System.Diagnostics
ASCIIFoldingFilter ( TokenStream input, bool preserveOriginal ) : System.Diagnostics	Create a new ASCIIFoldingFilter.
FoldToASCII ( char input, int inputPos, char output, int outputPos, int length ) : int	Converts characters above ASCII to their ASCII equivalents. For example, accents are removed from accented characters.
FoldToASCII ( char input, int length ) : void	Converts characters above ASCII to their ASCII equivalents. For example, accents are removed from accented characters.
IncrementToken ( ) : bool
Reset ( ) : void

Method Details

ASCIIFoldingFilter() public method

public ASCIIFoldingFilter ( TokenStream input ) : System.Diagnostics
input	TokenStream
return	System.Diagnostics

ASCIIFoldingFilter() public method

Create a new ASCIIFoldingFilter.

public ASCIIFoldingFilter ( TokenStream input, bool preserveOriginal ) : System.Diagnostics
input	TokenStream	/// TokenStream to filter
preserveOriginal	bool	/// should the original tokens be kept on the input stream with a 0 position increment /// from the folded tokens? ///
return	System.Diagnostics

FoldToASCII() public static method

Converts characters above ASCII to their ASCII equivalents. For example, accents are removed from accented characters.

public static FoldToASCII ( char input, int inputPos, char output, int outputPos, int length ) : int
input	char	The characters to fold
inputPos	int	Index of the first character to fold
output	char	The result of the folding. Should be of size >= {@code length * 4}.
outputPos	int	Index of output where to put the result of the folding
length	int	The number of characters to fold
return	int

FoldToASCII() public method

Converts characters above ASCII to their ASCII equivalents. For example, accents are removed from accented characters.

public FoldToASCII ( char input, int length ) : void
input	char	The string to fold
length	int	The number of characters in the input string
return	void

IncrementToken() public method

public IncrementToken ( ) : bool
return	bool

Reset() public method

public Reset ( ) : void
return	void