New tool: oxc_module_lexer

[Boshen]

Oxc Module Lexer

This is not a lexer. The name "lexer" is used for easier recognition.

es-module-lexer

Outputs the list of exports and locations of import specifiers, including dynamic import and import meta handling.

Does not have any limitations mentioned in es-module-lexer.

I'll also work on the following cases to make this feature complete.

• get imported variables Parse imported variables guybedford/es-module-lexer#163
• track star exports as imports as well Feature request: star export reporting guybedford/es-module-lexer#76
• TypeScript specific syntax
• TypeScript type import / export keyword

cjs-module-lexer

• TODO

Benchmark

This is 2 times slower than es-module-lexer, but will be significantly faster when TypeScript is processed.

The difference is around 10ms vs 20ms on a large file (700k).

[codspeed-hq]

CodSpeed Performance Report

Merging #2650 will not alter performance

_{Comparing module-lexer (49a4e6e) with main (66a64df)}

Summary

✅ 29 untouched benchmarks

[pastelsky]

Will this also cover both imports and exports for CJS?
cjs-module-lexer doesn't seem to support the former unless re-exported.

[Boshen]

Will this also cover both imports and exports for CJS? cjs-module-lexer doesn't seem to support the former unless re-exported.

Depending on the use case, it's difficult to statically analyze cjs ...