Stop consuming more bytes as soon as the final terminal is encountered?

[ssquirrel]

I am trying to embed participle into a larger parser. However it seems that participle will consume all the bytes from the reader. Is there a way to change this behavior? One way I can think of is supplying a custom lexer which emits fake EOF when needed.

[alecthomas]

Yep it's totally up to the Lexer. The builtin lexers do not support this at all, and the parser reads the entire token stream into memory before parsing.

[ssquirrel]

Thanks

[ssquirrel]

Also thank you so much for the amazing work!

[alecthomas]

You're welcome 🙂