Paul Stemmet
85c9a9f0c5
lib/scanner: improve eat_whitespace to chomp comments
2021-06-02 19:34:12 +01:00
Paul Stemmet
68cc3f7342
lib/scanner: improve tokens! macro error reporting
2021-06-02 19:34:12 +01:00
Paul Stemmet
9ecea201c8
lib/scanner: add fn for chomping whitespace between tokens
2021-06-02 16:09:24 +01:00
Paul Stemmet
bee55887f0
ci/prtasks: use install over mv
2021-06-02 14:52:43 +00:00
Paul Stemmet
7594379488
ci/prtasks: fix sccache version, improve curl output
2021-06-02 14:44:47 +00:00
Paul Stemmet
d4e13dd167
ci: move actions to repo root
2021-06-02 14:39:52 +00:00
Paul Stemmet
5cdf7bfc10
ci/prtasks: add actions for PR unit testing
2021-06-02 14:34:25 +00:00
Paul Stemmet
e90176db4b
add Cargo.lock file
2021-06-02 14:33:51 +00:00
Paul Stemmet
3e2135ce79
remove .lock from ignores
2021-06-02 14:33:37 +00:00
Paul Stemmet
dee8a69b71
lib/mod: add scanner + token
2021-06-01 19:10:44 +00:00
Paul Stemmet
bdc70312f1
scanner: add Scanner struct + tokens! macro
...
The scanner is the engine that will drive the underlying byte stream,
converting it to tokens. This struct will not attempt to impose semantic
restrictions on token ordering, that will be for high level data
structures.
2021-06-01 19:07:47 +00:00
Paul Stemmet
f4608a8588
token: add Token enum of possible tokens emitted
2021-06-01 19:04:29 +00:00
Paul Stemmet
847cf54400
Genesis
2021-06-01 13:31:00 +00:00