Dynamic environments.

[gitbluf]

Hello,

So I've been trying to do some dynamic targeting however I'm stumbling on this part of the docs => file

What is this file supposed to be?

I've tried:

• another .kluctl.yaml
• another deployment.yaml
• another kustomization dir
• another template
• another regular k8s manifest(no templating, basic yaml)

kluctl version: 2.12.5

None of these worked with each one complaining about unknown key.

Example errors:

 ✓ Loading kluctl project
  unmarshalling /Users/user/Documents/Dev/play/repo/apps/product-team/base/release.yaml failed: [5:10] unexpected mapping key
       2 | apiVersion: helm.toolkit.fluxcd.io/v2beta1
       3 | kind: HelmRelease
       4 | metadata:
    >  5 |   name: {{ se…

 ✓ Loading kluctl project
  unmarshalling /Users/user/Documents/Dev/play/repo/apps/product-team/base/kustomization.yaml failed: [3:1] unknown field "resources"
       1 | apiVersion: kustomize.config.k8s.io/v1beta1
       2 | kind: Kustomization
    >  3 | resources:

 ✓ Loading kluctl project
  unmarshalling /Users/user/Documents/Dev/play/repo/apps/product-team/podinfo/dynamic/dynamic.yaml failed: [1:1] unknown field "deployments"
    >  1 | deployments:
           ^
       2 | - path: ../../base
       3 |   vars:
       4 |   - file: values.…

 ✓ Loading kluctl project
  unmarshalling /Users/markopetrovic/Documents/Dev/play/repo/apps/product-team/podinfo/dynamic/dynamic.yaml failed: [5:1] unknown field "targets"
       2 | # - path: ../../base
       3 | #   vars:
       4 | #   - file: values.yaml
    >  5 | targets:
          …

[gitbluf]

Found solution. https://kluctl.io/docs/reference/kluctl-project/targets/dynamic-targets/#format-of-the-target-config

[codablock]

Happy you found it. If you have any suggestions on improving the documentation regarding this part, I'm happy to hear them (or even see a PR).

[gitbluf]

Just FYI: Unfortunately wasn't able to get it fully working as I wanted even tho I managed to figure out the above issue.
Some things are unclear to me:

• refPattern is supposed to check branches(remote/local?) based on pattern, however unless I specified the explicit branch name it does not pick it, and I'm I've checked the pattern on sites like https://regex101.com/, https://regexr.com/ and couple more similar ones. Not sure what is the issue here. Pattern: ^testing_([^\s]+) , branch name: testing_dynamic
• it is unclear how to implement this in GitOps setup with Flux considering that settings spec.target: "{{ target.targetConfig.ref }}" in KluctlDeployment doesn't work:
  {"level":"error","ts":"2022-07-12T15:58:26.619Z","msg":"Reconciliation failed after 310.345709ms, next try in 5m0s","controller":"kluctldeployment","controllerGroup":"flux.kluctl.io","controllerKind":"KluctlDeployment","kluctlDeployment":{"name":"product-team-dynamic","namespace":"dynamic"},"namespace":"dynamic","name":"product-team-dynamic","reconcileID":"0ae52c12-ab8b-4ffc-a3be-8c523f97d454","revision":"master/48f96f067ff1801f56fc8d4af563c7207e8e0129","error":"target {{ target.targetConfig.ref }} not existent in kluctl project config"} as this should be eq to above command. Idea behind this was to have a deployment that would do a deploy for every branch pattern it matches - this point might better in flux-kluctl-controller repository.

[codablock]

Can you try if using testing_([^\s]+) (without the ^) as pattern works? I'm prepending ^ and appending $ to all patterns, not sure how the go regex matcher behaves when ^ is duplicated.

Regarding the second question: What you're trying is not possible with the KluctlDeployment object alone. For this, there is the KluctlMultiDeployment. The docs for it are not synced to kluclt.io yet as I'm still working on that part. But as you're already quite on the bleeding edge, you can give it a try: https://github.com/kluctl/flux-kluctl-controller/blob/main/docs/spec/v1alpha1/kluctlmultideployment.md

But please note that the next release of the controller will already bring a few incompatible changes, I hope this won't disturb you too much.