Enum commands::tokenizer::TokenType
[−]
[src]
pub enum TokenType {
Whitespace,
Word,
}The role that a token plays: Whitespace or Word.
Variants
Whitespace | The token represents whitespace and not a word. | |
Word | The token represents a word within the body of text. This takes double quoted strings into account. |