Commit graph

5 commits

Author SHA1 Message Date
Paul Stemmet 3e2135ce79
remove .lock from ignores 2021-06-02 14:33:37 +00:00
Paul Stemmet dee8a69b71
lib/mod: add scanner + token 2021-06-01 19:10:44 +00:00
Paul Stemmet bdc70312f1
scanner: add Scanner struct + tokens! macro
The scanner is the engine that will drive the underlying byte stream,
converting it to tokens. This struct will not attempt to impose semantic
restrictions on token ordering, that will be for high level data
structures.
2021-06-01 19:07:47 +00:00
Paul Stemmet f4608a8588
token: add Token enum of possible tokens emitted 2021-06-01 19:04:29 +00:00
Paul Stemmet 847cf54400
Genesis 2021-06-01 13:31:00 +00:00