Feature/scanner/option #27

Merged
bazaah merged 19 commits from feature/scanner/option into master 2021-09-09 19:29:29 +00:00
Showing only changes of commit 55b8f31b7b - Show all commits

View file

@ -125,6 +125,12 @@ impl Scanner
return self.fetch_stream_end(*base, tokens); return self.fetch_stream_end(*base, tokens);
} }
// 4 characters is the longest token we can encounter, one
// of:
// - '--- '
// - '... '
cache!(~base, 4, opts)?;
// Fetch the next token(s) // Fetch the next token(s)
match base.as_bytes() match base.as_bytes()
{ {