jfun.parsec.tokens

Overview

Package

Class

Use

Tree

Deprecated

Index

Help

PREV PACKAGE NEXT PACKAGE

FRAMES NO FRAMES

Package jfun.parsec.tokens

Provides some predefined tokens and Tokenizer implementations.

See:
Description

Class Summary
MyToken	Deprecated.
NamedToken	A token that has a name.
TokenCharLiteral	Deprecated.
TokenDecimal	Deprecated.
TokenInteger	Deprecated.
Tokenizers	The facade class for all pre-built Tokenizer implementations.
TokenLong	Deprecated.
TokenQuoted	represents a string that is quoted by a open and close string.
TokenReserved	Deprecated.
Tokens	This class create some basic tokens.
TokenString	Deprecated.
TokenStringLiteral	Deprecated.
TokenWord	Deprecated.
TypedToken<Type>	Represents a token associated with a token type.

Enum Summary
TokenType	This represents all pre-built token types.

Provides some predefined tokens and Tokenizer implementations. These tokens are being used by the default behavior of some lexers.

The code is developed and tested under Java 5.0.