| Value | Meaning |
|---|---|
| String | That the token is: "SOME STRING" |
| Char | That the token is: 'C' # Some character |
| Integer | That the token an int (or uint, or ubyte) |
| Double | That the token is a double (floating point) value |
| Bool | a true or false value |
| Identifier | That the token is an identifier. i.e token is a variable name or a function name. For a token to be marked as Identifier, it doesn't need to be defined in new() |
| DataType | the token is a data type |
| MemberSelector | a member selector operator |
| AssignmentOperator | and assignmentOperator |
| Operator | That the token is an operator, like +, == etc |
| Keyword | A function or var ... |
| Comma | That its a comma: , |
| StatementEnd | A semicolon |
| ParanthesesOpen | ( |
| ParanthesesClose | ) |
| IndexBracketOpen | [ |
| IndexBracketClose | ] |
| BlockStart | { |
| BlockEnd | } |
Specifies type of token
used only in compiler.tokengen