Circus 0.0.1-alpha
C++ Serialization Framework
Loading...
Searching...
No Matches
circus::lexer__ Class Reference

Lexer for tokenizing input strings into Circus tokens. More...

#include <lexer.hpp>

Public Member Functions

 lexer__ () noexcept
 Default constructor. Initializes internal state.
std::vector< tokens__operator() (const std::string &input) noexcept
 Lex an input string and return tokens.
 lexer__ (lexer__ &&other)=default
 lexer__ (const lexer__ &other)=default
lexer__operator= (const lexer__ &other)=default
const std::string & get_input () const
 Get the input string currently being lexed.
 ~lexer__ ()=default
 Destructor.

Detailed Description

Lexer for tokenizing input strings into Circus tokens.

This class processes an input string and produces a vector of tokens representing literals, identifiers, reserved symbols, and comments.

It maintains internal cursor position tracking for line and column.

Member Function Documentation

◆ get_input()

const std::string & circus::lexer__::get_input ( ) const
inline

Get the input string currently being lexed.

Returns
Reference to input string.

◆ operator()()

std::vector< tokens__ > circus::lexer__::operator() ( const std::string & input)
inlinenodiscardnoexcept

Lex an input string and return tokens.

Parameters
inputInput string to lex.
Returns
Vector of tokens.

The documentation for this class was generated from the following file: