Enum Token

pub enum Token {
    LeftBracket,
    RightBracket,
    Uint(usize),
    Dot,
    Uid(Uid),
    Colon,
    DoubleSlash,
    BracketTypename(String),
    Ident(Ident),
    Error(String),
    Eof,
}

An identifier token.

Variants

LeftBracket

“[”

RightBracket

“]”

Uint(usize)

A decimal unsigned integer, can appear in brackets

Dot

“.”

Uid(Uid)

“-uid” suffixes, FLICKR58 format

Colon

“:”, can appear in brackets

DoubleSlash

“//”

BracketTypename(String)

Typename, within a bracket. These are rust identifiers, plus ‘:’ characters.

Ident(Ident)

An identifier, following rust rules.

Error(String)

Special token to denote a lexer error. It contains the unlexed remainder of the input. The error occured on the first character.

Eof

No more tokens.

Implementations

impl Token

pub fn into_left_bracket(self) -> Result<(), ParseError>

Return the token as a left bracket, otherwise a parse error.

pub fn into_right_bracket(self) -> Result<(), ParseError>

Return the token as a right bracket, otherwise a parse error.

pub fn into_uint(self) -> Result<usize, ParseError>

Return the token as a uint, otherwise a parse error.

pub fn into_dot(self) -> Result<(), ParseError>

Return the token as a dot, otherwise a parse error.

pub fn into_uid(self) -> Result<Uid, ParseError>

Return the token as a Uid, otherwise a parse error.

pub fn into_colon(self) -> Result<(), ParseError>

Return the token as a colon, otherwise a parse error.

pub fn into_double_slash(self) -> Result<(), ParseError>

Return the token as a double slash, otherwise a parse error.

pub fn into_bracket_typename(self) -> Result<String, ParseError>

Return the token as a bracket typename, otherwise a parse error.

pub fn into_ident(self) -> Result<Ident, ParseError>

Return the token as an ident, otherwise a parse error.

pub fn into_error(self) -> Result<String, ParseError>

Return the token as an error, otherwise a parse error.

Trait Implementations

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Token

impl StructuralPartialEq for Token