Pattern for matching brackets in multimode lexer

[dhowe]

I have a mode that should start with @{ and end with a matching }, and can contain abitrarily nested brackets (and any other characters). My tokens are as below. What is the best way to define the pattern for exit Gate token ? Or should I instead use a function that counts open/close brackets as shown in Custom Token Patterns ?

 const EnterGate = createToken({
    name: "EnterGate",
    pattern: /@{/
    push_mode: "gate"
  });

  const ExitGate = createToken({
    name: "ExitGate",
    pattern: /}/
    pop_mode: true
  });

  const Gate = createToken({
    name: "Gate",
    pattern: /.*/
  });

[msujew]

@dhowe You can push another mode to the mode stack (even the same mode) and keep the pop_mode: true for }. That way, you will only leave the mode when encountering a corresponding } for the first @{ that entered the mode.

[dhowe]

Is there a way to get the raw text for the entire mode ?

[msujew]

No, not really. If you want that, why create a multi mode lexer in the first place? You can just create a token that uses a custom matcher function to match everything between @{ and the corresponding }. No lexer mode necessary.

[dhowe]

I guess that makes more sense - and seems to work well once I figured out the format of the matcher function. Thanks!

[dhowe]

Thanks. This approach works in terms of tokens but I'm not sure how to get the full content of the mode (including all the brackets) into a rule. Would be ideal if I could match ONE rule with everything between the @{ and the last match }.

Here are a few examples (which would occur in the middle of a string of other tokens):

@{ a: { $exists: true }}
@{ a: "ab" }
@{ a: "繁體" }
@{ a: 3, $or: [ { b: { $lt: 30 } }, { c: /^p*/ } ] }