Skip navigation links
eBus
4.5.0

Package net.sf.eBus.text

Lexer takes a given input and returns a series of analyzed tokens.

See: Description

Package net.sf.eBus.text Description

Lexer takes a given input and returns a series of analyzed tokens. These tokens contain:

The most important difference between Lexer and java.util.StringTokenizer is that Lexer analyzes the tokens into types. Further, tokens are not created by breaking a line based on inter-field separator characters or by regular expression. Instead, Lexer searches for tokens based on types. This lexical package is designed to work with a higher level parser rather than a line-by-line text processor.

Skip navigation links
eBus
4.5.0