Commit graph

113 commits

Author SHA1 Message Date
Paul Stemmet 85c9a9f0c5 lib/scanner: improve eat_whitespace to chomp comments 2021-06-02 19:34:12 +01:00
Paul Stemmet 68cc3f7342 lib/scanner: improve tokens! macro error reporting 2021-06-02 19:34:12 +01:00
Paul Stemmet 9ecea201c8 lib/scanner: add fn for chomping whitespace between tokens 2021-06-02 16:09:24 +01:00
Paul Stemmet bee55887f0
ci/prtasks: use install over mv 2021-06-02 14:52:43 +00:00
Paul Stemmet 7594379488
ci/prtasks: fix sccache version, improve curl output 2021-06-02 14:44:47 +00:00
Paul Stemmet d4e13dd167
ci: move actions to repo root 2021-06-02 14:39:52 +00:00
Paul Stemmet 5cdf7bfc10
ci/prtasks: add actions for PR unit testing 2021-06-02 14:34:25 +00:00
Paul Stemmet e90176db4b
add Cargo.lock file 2021-06-02 14:33:51 +00:00
Paul Stemmet 3e2135ce79
remove .lock from ignores 2021-06-02 14:33:37 +00:00
Paul Stemmet dee8a69b71
lib/mod: add scanner + token 2021-06-01 19:10:44 +00:00
Paul Stemmet bdc70312f1
scanner: add Scanner struct + tokens! macro
The scanner is the engine that will drive the underlying byte stream,
converting it to tokens. This struct will not attempt to impose semantic
restrictions on token ordering, that will be for high level data
structures.
2021-06-01 19:07:47 +00:00
Paul Stemmet f4608a8588
token: add Token enum of possible tokens emitted 2021-06-01 19:04:29 +00:00
Paul Stemmet 847cf54400
Genesis 2021-06-01 13:31:00 +00:00