• 홈
• IronKonoha
• Tokenizer

C# 클래스 IronKonoha.Tokenizer

파일 보기 프로젝트 열기: tetsurom/ikonoha 1 사용 예제들

공개 메소드들

메소드	설명
Tokenize ( String script ) : IList
Tokenizer ( Context ctx, KonohaSpace ks ) : System

비공개 메소드들

메소드	설명
IsAlphaOrNum ( int c ) : bool
IsHexNumChar ( int c ) : bool
IsNumChar ( int c ) : bool
IsSymbolic ( int c ) : bool
TokenizeBlock ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeComment ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeDoubleQuote ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeIndent ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeLine ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeNextline ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeNumber ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeOneCharOperator ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeOperator ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeSkip ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeSlash ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeSymbol ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int
TokenizeUndefined ( Context ctx, Token &token, TokenizerEnvironment tenv, int tokStart, KMethod thunk ) : int

메소드 상세