|

Ionflux::Tools::TokenType Struct Reference
[String tokenizer]

Token type. More...

#include <Tokenizer.hpp>

List of all members.

Public Attributes
int	typeID
	Numeric token type ID.
std::string	validChars
	Valid characters for this token type.
bool	invert
	Whether to invert the matching behavior.
int	maxChars
	Maximum characters a token of this type can have.
Static Public Attributes
static const int	USERTYPE_ID = 100
	Token type ID: User type.

---

Detailed Description

Token type.

---

Member Data Documentation

bool Ionflux::Tools::TokenType::invert

Whether to invert the matching behavior. Set the invert flag if you want a token type to match any character except those specified in validChars.

int Ionflux::Tools::TokenType::maxChars

Maximum characters a token of this type can have. Set this to 0 (zero) or less to match any amount of characters.

int Ionflux::Tools::TokenType::typeID

Numeric token type ID.

const int Ionflux::Tools::TokenType::USERTYPE_ID = 100 [static]

Token type ID: User type. To define your own token types, use USERTYPE_ID + n as a token type ID, where n is a positive number unique to the token type in your application.

std::string Ionflux::Tools::TokenType::validChars

Valid characters for this token type.

---

The documentation for this struct was generated from the following files:

• Tokenizer.hpp
• Tokenizer.cpp

---