Support binarySource=install for all artifacts generation

[rarkins]

What would you like Renovate to be able to do?

Support binarySource=install for all relevant managers which use tools/managers to update artifacts.

If you have any ideas on how this should be implemented, please tell us here.

This issue will be a meta issue and we should have sub-issues for each which needs it. Sub-issues:

• bundler (Support binarySource=install for bundler #13684)
• cargo (Support binarySource=install for cargo #13685)
• cocoapods (Support binarySource=install for cocoapods #13686)
• composer
• gomod (Support binarySource=install for go #13727)
• gradle-wrapper (feat(manager/gradle-wrapper): support binarySource=install #16830)
• helmv3 (feat(helm): support binarySource=install #13719)
• jsonnet-bundler
• mix (feat(manager/elixir): support install binary source #16710)
• npm/lerna (Lerna support with binarySource: 'install' #13599)
• npm/npm
• npm/pnpm (feat(npm): support binarySource=install for pnpm #13723)
• npm/yarn (feat(manager:npm): support binarySource=install for yarn #15414)
• dotnet/nuget (Support binarySource=install for nuget #13728)
• pip-compile (feat(manager/pip-compile): support buildpack #16996)
• pip_requirements (feat(manager/pip_requirements): support buildpack #16999)
• poetry (feat(manager/poetry): support buildpack #17002)
• pipenv (feat(manager/pipenv): support binarySource=install #16828)
• ruby (Support binarySource=install for ruby (bundler) #18660) (for bundler and cocoapods)
• rust (Support binarySource=install for rust #18661)

Note: the above scope does not extend to language installs (e.g. node, java) which should be done afterwards, with a similar list. Eventually everything will have a renovate/sidecar base image like jsonnet-bundler does.

This issue is closely linked to containerbase/base#16

Is this a feature you are interested in implementing yourself?

Maybe

[rarkins]

Here's how I test this locally:

First, I docker pull renovate/renovate to make sure I'm on the latest.

Next, I use config.js for configuration as it's most convenient for me. e.g. I can set binarySource: 'install' within this config.js. I also have token: process.env.GITHUB_RENOVATE_TESTS_TOKEN.

Before testing out new code, it's essential to run yarn build.

Then from my Renovate source directory:

docker run --rm -e GITHUB_RENOVATE_TESTS_TOKEN -e LOG_LEVEL=debug -w `pwd` -v `pwd`:`pwd` renovate/renovate node dist/renovate org-to-be-tested/repo-to-be-tested

[rarkins]

Here's the candidate list of tools:

❯ curl -s https://raw.githubusercontent.com/renovatebot/docker-renovate-full/main/Dockerfile | grep "install-tool"
RUN install-tool node v14.18.3
RUN install-tool yarn 1.22.17
RUN install-tool docker 20.10.12
RUN install-tool java 11.0.13+8
RUN install-tool gradle 6.9.2
RUN install-tool erlang 22.3.2
RUN install-tool elixir 1.13.2
RUN install-tool php 7.4.27
RUN install-tool composer 2.2.4
RUN install-tool golang 1.17.6
RUN install-tool python 3.10.2
RUN install-tool poetry 1.1.12
RUN install-tool rust 1.58.1
RUN install-tool ruby 3.1.0
RUN install-tool dotnet 6.0.101
RUN install-tool pnpm 6.26.1
RUN install-tool helm v3.7.2

Tools can be checked for runtime compatibility within https://github.com/containerbase/buildpack/tree/main/src/usr/local/buildpack/tools

Example of one which supports user install: https://github.com/containerbase/buildpack/blob/main/src/usr/local/buildpack/tools/helm.sh

Example of one which does not: https://github.com/containerbase/buildpack/blob/26cf7d7273177157cfa1d09af62e8a8e8a189e83/src/usr/local/buildpack/tools/dotnet.sh#L5

[rarkins]

❯ find lib/modules/manager | grep artifacts.ts | xargs grep "image: '" | grep -v sidecar
lib/modules/manager/gomod/artifacts.ts:        image: 'go',
lib/modules/manager/cargo/artifacts.ts:      image: 'rust',
lib/modules/manager/nuget/artifacts.ts:      image: 'dotnet',
lib/modules/manager/cocoapods/artifacts.ts:      image: 'ruby',
lib/modules/manager/bundler/artifacts.ts:        image: 'ruby',

[rarkins]

Go should be the least priority because running everything using latest go version is usually OK. ruby should be highest priority because it often needs an exact version installed. So ruby > dotnet > rust > go

[rarkins]

❯ find lib/modules/manager | grep artifacts.ts | xargs grep "image: '" | grep -v sidecar
lib/modules/manager/cargo/artifacts.ts:      image: 'rust',
lib/modules/manager/cocoapods/artifacts.ts:      image: 'ruby',
lib/modules/manager/bundler/artifacts.ts:        image: 'ruby',

[viceice]

rust PR open 🎉

[renovate-release]

🎉 This issue has been resolved in version 34.69.0 🎉

The release is available on:

• GitHub release
• 34.69.0

Your semantic-release bot 📦🚀