Maybe a bug

[lylythechosenone]

I have a doc comment token, that uses the following regexes:

• ///[^\n]*
• /\*\*([^\*]|\*[^\*/]|\*\*[^/])*\*?\*/

As well as a regular comment token, that skips the following regexes:

• //[^\n]*
• /\*([^\*]|\*[^/])*\*/

And for some reason, these tests pass:

// first test
let input = "// hello world
/* hello world */
/// hello world doc
/** hello world doc **/";
let mut lexer = Token::lexer(input);
assert_eq!(lexer.next(), Some(Token::Doc("hello world doc")));
assert_eq!(lexer.next(), Some(Token::Doc("hello world doc")));

// second test
let input = "// hello world
/* hello world */
/// hello world doc
/** hello world doc */
";
let mut lexer = Token::lexer(input);
assert_eq!(lexer.next(), Some(Token::Doc("hello world doc")));
assert_eq!(lexer.next(), Some(Token::Doc("hello world doc")));

While this one doesn't:

let input = "// hello world
/* hello world */
/// hello world doc
/** hello world doc **/
";
let mut lexer = Token::lexer(input);
assert_eq!(lexer.next(), Some(Token::Doc("hello world doc")));
assert_eq!(lexer.next(), Some(Token::Doc("hello world doc")));

In this last one, the multiline comment is turned into an Error.

My lexer