org.kotemaru.wsjs.exjs
クラス JsTokenizer

java.lang.Object
  上位を拡張 org.kotemaru.wsjs.exjs.JsTokenizer
すべての実装されたインタフェース:
Tokenizer

public class JsTokenizer
extends java.lang.Object
implements Tokenizer


コンストラクタの概要
JsTokenizer()
           
 
メソッドの概要
static Token pIdentifier(BnfDriver driver)
          Identifier ::= /[a-za-Z$_][a-za-Z$_0-9]* /
static Token pMultiLineComment(BnfDriver driver)
          MultiLineComment = C style comment.
static Token pNumber(BnfDriver driver)
          DecimalLiteral ::= DecimalLiteral_0|DecimalLiteral_1|DecimalLiteral_2; DecimalLiteral_0 ::= /[0-9]+([eE]-?
static Token pString(BnfDriver driver)
          StringLiteral ::= StringLiteralQuote | StringLiteralApos; StringLiteralQuote ::= /"([^\\"]|\\['"\\bfnrtv]|\\\r\n|\\0[0-9]*|\\x[0-9a-zA-Z]{2}|\\u[0-9a-zA-Z]{4})*"/; StringLiteralApos ::= /'([^\\']|\\['"\\bfnrtv]|\\\r\n|\\0[0-9]*|\\x[0-9a-zA-Z]{2}|\\u[0-9a-zA-Z]{4})*'/;
 Token tokenize(BnfDriver driver)
          StringLiteral, Number, Identifier, MultiLineComment, Punctuator
 
クラス java.lang.Object から継承されたメソッド
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

コンストラクタの詳細

JsTokenizer

public JsTokenizer()
メソッドの詳細

tokenize

public Token tokenize(BnfDriver driver)
StringLiteral, Number, Identifier, MultiLineComment, Punctuator

定義:
インタフェース Tokenizer 内の tokenize
戻り値:
null is tokenize failed.

pString

public static Token pString(BnfDriver driver)
StringLiteral ::= StringLiteralQuote | StringLiteralApos; StringLiteralQuote ::= /"([^\\"]|\\['"\\bfnrtv]|\\\r\n|\\0[0-9]*|\\x[0-9a-zA-Z]{2}|\\u[0-9a-zA-Z]{4})*"/; StringLiteralApos ::= /'([^\\']|\\['"\\bfnrtv]|\\\r\n|\\0[0-9]*|\\x[0-9a-zA-Z]{2}|\\u[0-9a-zA-Z]{4})*'/;


pNumber

public static Token pNumber(BnfDriver driver)
DecimalLiteral ::= DecimalLiteral_0|DecimalLiteral_1|DecimalLiteral_2; DecimalLiteral_0 ::= /[0-9]+([eE]-?[0-9]+)?/; DecimalLiteral_1 ::= /[.][0-9]+([eE]-?[0-9]+)?/; DecimalLiteral_2 ::= /[0-9]+[.][0-9]*([eE]-?[0-9]+)?/;


pIdentifier

public static Token pIdentifier(BnfDriver driver)
Identifier ::= /[a-za-Z$_][a-za-Z$_0-9]* /


pMultiLineComment

public static Token pMultiLineComment(BnfDriver driver)
MultiLineComment = C style comment.



Copyright © 2009 kotemaru.