Identifying Helm OCI charts in skaffold.yaml using regex customManager

[chinmaya-n]

What would you like help with?

I would like help with my configuration

How are you running Renovate?

Self-hosted

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

GitHub

Please tell us more about your question or problem

When using skaffold.yaml to deploy Helm OCI charts, I'm facing a problem to properly identify the dependency, repositoryURL etc. I'm using regex customManager because skaffold.yaml doesn't have its own manager (yet). Below is an example of a skaffold file which uses an OCI helm chart to deploy the application. I believe the problem is, I'm unable to identify proper names for the capture groups and the datasource for this task.

apiVersion: skaffold/v4beta10
kind: Config
deploy:
  helm:
    releases:
    - name: gha-runner-scale-set-controller
      remoteChart: oci://ghcr.io/actions/actions-runner-controller-charts/gha-runner-scale-set-controller
      valuesFiles:
        - values-arc.yaml
      namespace: gha-controller
      createNamespace: true
      version: 0.9.0
      upgradeOnChange: true
    - name: gha-runner-scale-set
      remoteChart: oci://ghcr.io/actions/actions-runner-controller-charts/gha-runner-scale-set
      valuesFiles:
        - values-runner-scale-set.yaml
      namespace: gha-runners
      createNamespace: true
      version: 0.9.0
      upgradeOnChange: true

Here is the regex customManager config:

{
"customManagers": [
        {
            "customType": "regex",
            "fileMatch": ["^skaffold.yaml$"],
            "matchStrings": [
                "\\s+remoteChart:\\s+(?<repositoryURL>oci:\/\/(?<registryHost>.*?)\/.*)\/(?<depName>.*?)\\s+(.|\\s)*?version:\\s+('|\")?(?<currentValue>.*?)('|\")?\\s+"
            ],
            "datasourceTemplate": "helm"
        }
    ]
}

I tried multiple regex match strings (some are below) and also tried both helm and docker as the datasource without any luck. All I get is "Package lookup failures". Here is a saved regex101 search link to quickly validate the match strings.

• \s+remoteChart:\s+(?<registryUrl>oci:.*\/(?<depName>.*?))\s+(.|\s)*?version:\s+('|")?(?<currentValue>.*?)('|")?\s+
• \s+remoteChart:\s+(?<registryUrl>oci:.*)\/(?<depName>.*?)\s+(.|\s)*?version:\s+('|")?(?<currentValue>.*?)('|")?\s+
• \s+remoteChart:\s+(?<registryUrl>oci:\/\/(?<registryHost>.*?)\/(?<dockerRepository>.*))\/(?<depName>.*?)\s+(.|\s)*?version:\s+('|")?(?<currentValue>.*?)('|")?\s+
• \s+remoteChart:\s+oci:\/\/(?<registryHost>.*?)\/(?<dockerRepository>.*)\/(?<depName>.*?)\s+(.|\s)*?version:\s+('|")?(?<currentValue>.*?)('|")?\s+
• \s+remoteChart:\s+(?<repositoryURL>oci:\/\/(?<registryHost>.*?)\/.*)\/(?<depName>.*?)\s+(.|\s)*?version:\s+('|")?(?<currentValue>.*?)('|")?\s+

I failed to find any appropriate documentation around this. I would appreciate any pointers regarding this.

Logs (if relevant)

Logs

WARN: Package lookup failures (repository=*****/k8s-github-arc)                                                                                                                
       "warnings": [                                                                                                                                                                  
         "Failed to look up helm package gha-runner-scale-set-controller",                                                                                                            
         "Failed to look up helm package gha-runner-scale-set"                                                                                                                        
       ],

[rarkins]

Pick the one way which you think/hope should work. What does the packageFiles with updates look like for it?

[chinmaya-n]

If you mean packages that have updates, both GitHub runner controller and the runners helm charts have a newer version than 0.9.0 when I tried this.

[secustor]

You have to use datasourceTemplate: docker as you want to lookup values from a Docker registry not a classic helm one.

[chinmaya-n]

I did try docker as the datasource along with helm but failed. Can you tell me what capture group names should I use for the docker datasource to understand my intent? As you can see in the regex patterns I tried (listed above), like registryURL, repositoryUrl etc, none have worked as expected and I couldn't find the right documentation around that.

Also, I will share the errors I receive when I change it to docker datasource in a bit.

[secustor]

If you do not want to overwrite the registry where non scoped images are looked up e.g. renovatebot/renovate you do not have to specify a registryUrl

Simply capture depName or packageName ( if you have set depName to something custom ) so that the value is ghcr.io/actions/actions-runner-controller-charts/gha-runner-scale-set.

[chinmaya-n]

Perfect. That fixed my issue. It just needed the depName without the oci:// and the currentValue. I wish this was mentioned in documentation somewhere regarding oci helm charts.

[secustor]

Docs PRs are always welcome. It probably would make sense to add some examples from the tests to be added to the Docker datasource docs. https://github.com/renovatebot/renovate/blob/main/lib/modules/datasource/docker/readme.md