Class: Token (Umu::Lexical::Lexer)

Overview
Module Structure
Class Hierarchy
Constants
Token::IDENT_WORD
Token::MODULE_DIRECTORY_PATTERN
Token::IDENT_PATTERN
Token::RESERVED_WORDS
Token::RESERVED_SYMBOLS
Token::IDENTIFIER_SYMBOLS
Token::BRAKET_PAIRS
Token::BRAKET_MAP_OF_BEGIN_TO_END
Token::BEGIN_BRAKET_SYMBOLS
Token::END_BRAKET_SYMBOLS
Token::SYMBOL_PATTERNS
Instance Methods
Token#lex / 1
is a submodule of
module: Lexer ( Umu::Lexical )
has modular siblings
class: Abstract   
class: Separator   
class: Comment   
module: String   
inherits from
  Abstract ( Umu::Lexical::Lexer )
has class siblings
  Separator ( Umu::Lexical::Lexer )
  Comment ( Umu::Lexical::Lexer )
  Abstract ( Umu::Lexical::Lexer::String )
has properties
constant: IDENT_WORD   
constant: MODULE_DIRECTORY_PATTERN   
constant: IDENT_PATTERN   
constant: RESERVED_WORDS   
constant: RESERVED_SYMBOLS   
constant: IDENTIFIER_SYMBOLS   
constant: BRAKET_PAIRS   
constant: BRAKET_MAP_OF_BEGIN_TO_END   
constant: BEGIN_BRAKET_SYMBOLS   
constant: END_BRAKET_SYMBOLS   
constant: SYMBOL_PATTERNS   
method: lex / 1   
is defined at
#12 in lexical/lexer/token.rb  

Overview

Module Structure

  module: <Toplevel Module>
  module: Umu
  module: Lexical
  module: Lexer
  class: Abstract
  class: Separator
  class: Comment
✗ class: Token
  module: String
class: Abstract     

Class Hierarchy

Object ( Builtin-Module )
Record ( Umu::Abstraction )
has properties
class method: __deconstruct_keys__   
method: deconstruct_keys   
method: update / 1   
Abstract ( Umu::Lexical::Lexer )
has properties
attribute: loc [R]   
attribute: braket_stack [R]   
class method: deconstruct_keys   
method: initialize / 2   
method: to_s   
method: comment_depth   
method: braket_depth   
method: in_comment?   
method: in_braket?   
method: between_braket?   
method: next_line_num / 1   
method: recover   
method: lex / 1   
method: __make_separator__ / 2   
method: __make_comment__ / 5   
method: __make_token__ / 2   
method: __make_string__ / 3   
method: __make_symbolized_string__ / 3   
Separator ( Umu::Lexical::Lexer )
Comment ( Umu::Lexical::Lexer )
Token ( Umu::Lexical::Lexer )
has properties
constant: IDENT_WORD   
constant: MODULE_DIRECTORY_PATTERN   
constant: IDENT_PATTERN   
constant: RESERVED_WORDS   
constant: RESERVED_SYMBOLS   
constant: IDENTIFIER_SYMBOLS   
constant: BRAKET_PAIRS   
constant: BRAKET_MAP_OF_BEGIN_TO_END   
constant: BEGIN_BRAKET_SYMBOLS   
constant: END_BRAKET_SYMBOLS   
constant: SYMBOL_PATTERNS   
method: lex / 1   
Abstract ( Umu::Lexical::Lexer::String )

Constants

Token::IDENT_WORD

#14 in lexical/lexer/token.rb

IDENT_WORD = '(_*[[:alpha:]][[:alnum:]]*(\-[[:alnum:]]+)*_*[\?!]?\'*)'   

Token::MODULE_DIRECTORY_PATTERN

#17 in lexical/lexer/token.rb

MODULE_DIRECTORY_PATTERN = Regexp.new IDENT_WORD + '::'   

Token::IDENT_PATTERN

#18 in lexical/lexer/token.rb

IDENT_PATTERN = Regexp.new '([@$\.])?' + IDENT_WORD + '(:)?'   

Token::RESERVED_WORDS

#20 in lexical/lexer/token.rb

RESERVED_WORDS = [   

Token::RESERVED_SYMBOLS

#77 in lexical/lexer/token.rb

RESERVED_SYMBOLS = [   

Token::IDENTIFIER_SYMBOLS

#104 in lexical/lexer/token.rb

IDENTIFIER_SYMBOLS = [   

Token::BRAKET_PAIRS

#113 in lexical/lexer/token.rb

BRAKET_PAIRS = [   

Token::BRAKET_MAP_OF_BEGIN_TO_END

#142 in lexical/lexer/token.rb

BRAKET_MAP_OF_BEGIN_TO_END = BRAKET_PAIRS.inject({}) { |hash, (bb, eb)|   

Token::BEGIN_BRAKET_SYMBOLS

#149 in lexical/lexer/token.rb

BEGIN_BRAKET_SYMBOLS = BRAKET_PAIRS.inject({}) { |hash, (bb, _eb)|   

Token::END_BRAKET_SYMBOLS

#156 in lexical/lexer/token.rb

END_BRAKET_SYMBOLS = BRAKET_PAIRS.inject({}) { |hash, (_bb, eb)|   

Token::SYMBOL_PATTERNS

#161 in lexical/lexer/token.rb

SYMBOL_PATTERNS = [   

Instance Methods

Token#lex / 1

#177 in lexical/lexer/token.rb

lex ( scanner )