Enum commands::tokenizer::TokenType
[−]
[src]
pub enum TokenType { Whitespace, Word, }
The role that a token plays: Whitespace
or Word
.
Variants
Whitespace | The token represents whitespace and not a word. | |
Word | The token represents a word within the body of text. This takes double quoted strings into account. |