Tokenizer Class |
[Missing <summary> documentation for "T:Demo3D.Core.Factory.Expression.Tokenizer"]
Namespace: Demo3D.Core.Factory.Expression
public class Tokenizer
The Tokenizer type exposes the following members.
| Name | Description | |
|---|---|---|
| Identifier |
The identifier string.
| |
| Number |
The numeric value.
| |
| Token |
The current token.
|
| Name | Description | |
|---|---|---|
| NextCharacter |
Reads the next character from the input stream and stores it as the current
character.
| |
| NextToken |
Reads the next token from the input stream and stores it as the current token.
|