daniellemaywood / glexer

Gleam lexer implemented in Gleam!

Hi, I'm Danielle 👋

glexer's Issues

Consider unboxing positions

Hello!

I'm finding it a little annoying having to pattern match on the Position records to get the position int out of them. Seeing as this type does nothing would you consider unboxing it and just returning the int?

Thanks,
Louis

Use stdlib iterator

Hello!

This library has a mechanism for lazily emitting a token stream, and a function for realising this stream to a list.

What do you think of using the iterator module for this? It would make it easier to integrate with other libraries. It would fix the stack overflow bug in the lex function (due to it currently not being tail recursive).

Error lexing hex numbers

When trying to lex the hex number 0x2c in a pattern for a case branch, the produced tokens treated c as a name and 0x2 as the number.

string.byte_size exists now should we use it?

glexer/test/glexer_old.gleam

Line 291 in 9fd5fe4

// This should use string.byte_size, but that function does not exist yet.

Line Numbers

Would you be opposed to a PR adding line numbers to Glexer's output? We could use line numbers in the linter we're hacking on.