|

Tokenizer.hpp File Reference

Generic byte string tokenizer header. More...

#include <string>
#include <iostream>
#include <vector>
#include "ionflux/tools.hpp"
#include "ionflux/TokenTypeMap.hpp"

Include dependency graph for Tokenizer.hpp:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Namespaces
namespace	Ionflux
namespace	Ionflux::Tools
Classes
struct	Ionflux::Tools::TokenType
	Token type. More...
struct	Ionflux::Tools::Token
	Token. More...
class	Ionflux::Tools::Tokenizer
	Generic byte string tokenizer. More...

---

Detailed Description

Generic byte string tokenizer header.

---