Tokenizer Methods |
The Tokenizer type exposes the following members.
| Name | Description | |
|---|---|---|
| NextCharacter |
Reads the next character from the input stream and stores it as the current
character.
| |
| NextToken |
Reads the next token from the input stream and stores it as the current token.
|