A DFA state. It defines the logic that produces tokens out of strings. It consists of edges that the tokenizer follows, depending on the character it encounters.
| Record Field | Description |
|
Whether this state accepts a symbol or not.
|
Full Usage:
AnythingElse
Field type: uint32 option
|
The state to maybe go to (or fail) in case the character had no matching edge.
|
The edges of the state, that match a character to a next state, using a custom data structure. A character can be set to explicitly fail, prohibiting the use of `AnythingElse`.
|
|
Full Usage:
Index
Field type: uint32
|
The index of the state in the DFA state table.
|