Circus 0.0.1-alpha
C++ Serialization Framework
|
Lexer for tokenizing input strings into Circus tokens. More...
#include <lexer.hpp>
Public Member Functions | |
lexer__ () noexcept | |
Default constructor. Initializes internal state. | |
std::vector< tokens__ > | operator() (const std::string &input) noexcept |
Lex an input string and return tokens. | |
lexer__ (lexer__ &&other)=default | |
lexer__ (const lexer__ &other)=default | |
lexer__ & | operator= (const lexer__ &other)=default |
const std::string & | get_input () const |
Get the input string currently being lexed. | |
~lexer__ ()=default | |
Destructor. |
Lexer for tokenizing input strings into Circus tokens.
This class processes an input string and produces a vector of tokens representing literals, identifiers, reserved symbols, and comments.
It maintains internal cursor position tracking for line and column.
|
inline |
Get the input string currently being lexed.
|
inlinenodiscardnoexcept |
Lex an input string and return tokens.
input | Input string to lex. |