Install python and pip behind corporate proxy #1687

y0x · 2023-08-08T13:13:58Z

y0x
Aug 8, 2023

Currently trying to build our own docker image based on renovate slim and using this in AWS ECR. Before we used the full image where python and pip was already installed, but due to too many security vulnerablities in that image we are now forced to go with the slim version and only install what we actually need to minimise the findings.

Our entire network traffic goes through a ssl inspector, which means I have to always provide a specific ssl certificate in order to reach the internet.

FROM renovate/renovate:latest

USER 0
COPY cert.pem /usr/local/share/ca-certificates/my-root-ca.crt
RUN update-ca-certificates

# configure node
ENV NODE_EXTRA_CA_CERTS=/usr/local/share/ca-certificates/my-root-ca.crt

RUN curl https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip -o "awscliv2.zip" && \
    unzip awscliv2.zip && \
    ./aws/install && \
    rm -rf awscliv2.zip ./aws

# renovate: datasource=github-releases lookupName=containerbase/python-prebuild
RUN install-tool python 3.11.4

In general this works, but I got a bit confused that when trying to run RUN install-tool python 3.11.4 it actually seems to use pip to install this or I got this wrong. But I see this message when trying to build the image:

 > [5/8] RUN install-tool python 3.11.4:
#9 0.496 [12:52:37.456] INFO (1): Installing tool python v3.11.4...
#9 0.508 installing v2 tool python v3.11.4
#9 12.99 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/pip/
#9 13.63 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/pip/
#9 14.78 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/pip/
#9 16.94 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/pip/
#9 21.09 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/pip/
#9 21.44 WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/virtualenv/
#9 22.09 WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/virtualenv/
#9 23.23 WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/virtualenv/
#9 25.44 WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/virtualenv/
#9 29.60 WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /simple/virtualenv/
#9 29.75 ERROR: Could not find a version that satisfies the requirement virtualenv (from versions: none)
#9 29.75 ERROR: No matching distribution found for virtualenv
#9 29.83 [12:53:06.791] FATAL (1): Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4
#9 29.83     err: {
#9 29.83       "type": "Error",
#9 29.83       "message": "Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4",
#9 29.83       "stack":
#9 29.83           Error: Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4
#9 29.83               at makeError (/snapshot/dist/containerbase-cli.js:40984:13)
#9 29.83               at handlePromise (/snapshot/dist/containerbase-cli.js:41440:29)
#9 29.83               at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
#9 29.83               at async InstallLegacyToolService.execute (/snapshot/dist/containerbase-cli.js:42312:5)
#9 29.83               at async InstallToolService.execute (/snapshot/dist/containerbase-cli.js:42478:7)
#9 29.83               at async InstallToolShortCommand.execute (/snapshot/dist/containerbase-cli.js:42547:14)
#9 29.83               at async InstallToolShortCommand.validateAndExecute (/snapshot/dist/containerbase-cli.js:1342:26)
#9 29.83               at async _Cli.run (/snapshot/dist/containerbase-cli.js:2455:22)
#9 29.83               at async _Cli.runExit (/snapshot/dist/containerbase-cli.js:2463:28)
#9 29.83               at async main (/snapshot/dist/containerbase-cli.js:42707:3)
#9 29.83       "shortMessage": "Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4",
#9 29.83       "command": "/usr/local/containerbase/bin/install-tool python 3.11.4",
#9 29.83       "escapedCommand": "\"/usr/local/containerbase/bin/install-tool\" python 3.11.4",
#9 29.83       "exitCode": 1,
#9 29.83       "cwd": "/usr/src/app",
#9 29.83       "failed": true,
#9 29.83       "timedOut": false,
#9 29.83       "isCanceled": false,
#9 29.83       "killed": false
#9 29.83     }

Is there a way to use the install-tool toolset for my purpose or do I have to install python & pip via curl for example?

viceice · 2023-08-08T15:21:55Z

viceice
Aug 8, 2023
Maintainer

this command seems to fail: 🤔

https://github.com/containerbase/base/blob/ce376824eeac2db23a17e27b91928bd1e92af55f/src/usr/local/containerbase/tools/v2/python.sh#L89

0 replies

viceice · 2023-08-08T15:23:51Z

viceice
Aug 8, 2023
Maintainer

so pip is failing. shouldn't python and pip use the system certificates? 🤔

0 replies

viceice · 2023-08-08T15:25:43Z

viceice
Aug 8, 2023
Maintainer

https://github.com/containerbase/base/blob/ce376824eeac2db23a17e27b91928bd1e92af55f/test/latest/Dockerfile#L82

0 replies

y0x · 2023-08-09T09:13:32Z

y0x
Aug 9, 2023
Author

Hm, I tried a few things now... do you have an idea whats else I could try?


ENV SSL_CERT_FILE=/usr/local/share/ca-certificates/my-root-ca.crt
ENV REQUESTS_CA_BUNDLE=/usr/local/share/ca-certificates/my-root-ca.crt
ENV CURL_CA_BUNDLE=/usr/local/share/ca-certificates/my-root-ca.crt

COPY cert.pem /test/ca.pem

RUN install-tool python 3.11.4

0 replies

viceice · 2023-08-09T10:09:48Z

viceice
Aug 9, 2023
Maintainer

Please test this:

FROM renovate/renovate

USER 0
COPY cert.pem /usr/local/share/ca-certificates/my-root-ca.crt
RUN update-ca-certificates

# configure node
ENV NODE_EXTRA_CA_CERTS=/usr/local/share/ca-certificates/my-root-ca.crt

ARG CONTAINERBASE_DEBUG=true

# renovate: datasource=github-releases lookupName=containerbase/python-prebuild
RUN install-tool python 3.11.4

this should give a lot more output, please post it here

0 replies

viceice · 2023-08-09T10:11:27Z

viceice
Aug 9, 2023
Maintainer

Converted to discussion, as this repo is the wrong place for that error. When we found the cause, we can open a new issue on the appropriate repo.

0 replies

y0x · 2023-08-09T11:50:53Z

y0x
Aug 9, 2023
Author

 => ERROR [6/6] RUN install-tool python 3.11.4                                                                                                                         20.1s 
------
 > [6/6] RUN install-tool python 3.11.4:
#10 0.654 [11:25:57.291] DEBUG (1): discovered distro
#10 0.654     distro: {
#10 0.654       "name": "Ubuntu",
#10 0.654       "versionCode": "focal",
#10 0.654       "versionId": "20.04"
#10 0.654     }
#10 0.663 [11:25:57.292] DEBUG (1): prepare commands
#10 0.663 [11:25:57.294] INFO (1): Installing tool python v3.11.4...
#10 0.663 [11:25:57.297] DEBUG (1): supported tools
#10 0.663     tools: [
#10 0.663       "corepack",
#10 0.663       "docker",
#10 0.663       "dart",
#10 0.663       "flux",
#10 0.663       "lerna",
#10 0.663       "npm",
#10 0.663       "pnpm",
#10 0.663       "renovate",
#10 0.663       "yarn",
#10 0.663       "yarn-slim"
#10 0.663     ]
#10 0.663 [11:25:57.297] DEBUG (1): Installing legacy tool python v3.11.4 ...
#10 0.666 ++ [[ -z x ]]
#10 0.666 ++ SEMVER_REGEX='^(0|[1-9][0-9]*)(\.(0|[1-9][0-9]*))?(\.(0|[1-9][0-9]*))?(\+[0-9]+)?([a-z-].*)?$'
#10 0.666 + require_arch
#10 0.666 + local arch
#10 0.666 ++ uname -p
#10 0.667 + arch=x86_64
#10 0.667 + case "$arch" in
#10 0.667 + require_distro
#10 0.667 + local VERSION_CODENAME
#10 0.667 ++ . /etc/os-release
#10 0.667 +++ NAME=Ubuntu
#10 0.667 +++ VERSION='20.04.6 LTS (Focal Fossa)'
#10 0.667 +++ ID=ubuntu
#10 0.667 +++ ID_LIKE=debian
#10 0.667 +++ PRETTY_NAME='Ubuntu 20.04.6 LTS'
#10 0.667 +++ VERSION_ID=20.04
#10 0.667 +++ HOME_URL=https://www.ubuntu.com/
#10 0.667 +++ SUPPORT_URL=https://help.ubuntu.com/
#10 0.667 +++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/
#10 0.667 +++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy
#10 0.667 +++ VERSION_CODENAME=focal
#10 0.667 +++ UBUNTU_CODENAME=focal
#10 0.667 ++ echo focal
#10 0.667 + VERSION_CODENAME=focal
#10 0.667 + case "$VERSION_CODENAME" in
#10 0.667 + require_user
#10 0.668 + [[ -z ubuntu ]]
#10 0.668 + require_tool python 3.11.4
#10 0.668 + local tool=python
#10 0.668 + [[ -z python ]]
#10 0.668 + local tool_env
#10 0.668 + local version
#10 0.668 ++ get_tool_version_env python
#10 0.668 ++ local tool=python
#10 0.668 ++ check tool true
#10 0.668 ++ '[' SET '!=' SET ']'
#10 0.668 ++ '[' -n true ']'
#10 0.668 ++ '[' -z python ']'
#10 0.668 ++ tool=PYTHON_VERSION
#10 0.668 ++ echo PYTHON_VERSION
#10 0.668 + tool_env=PYTHON_VERSION
#10 0.668 + version=3.11.4
#10 0.668 + [[ -z 3.11.4 ]]
#10 0.668 + local 'VERSION_PREFIX=^v?(.+)'
#10 0.669 + [[ 3.11.4 =~ ^v?(.+) ]]
#10 0.669 + version=3.11.4
#10 0.669 + export TOOL_NAME=python TOOL_VERSION=3.11.4
#10 0.669 + TOOL_NAME=python
#10 0.669 + TOOL_VERSION=3.11.4
#10 0.669 + export PYTHON_VERSION=3.11.4
#10 0.669 + PYTHON_VERSION=3.11.4
#10 0.669 ++ ignore_tool
#10 0.669 ++ local tools=
#10 0.669 ++ [[ '' =~ (^|,)python($|,) ]]
#10 0.670 ++ echo 0
#10 0.670 + [[ 0 -eq 1 ]]
#10 0.670 + TOOL=/usr/local/containerbase/tools/python.sh
#10 0.670 + V2_TOOL=/usr/local/containerbase/tools/v2/python.sh
#10 0.670 + [[ -f /usr/local/containerbase/tools/v2/python.sh ]]
#10 0.670 + install_v2_tool /usr/local/containerbase/tools/v2/python.sh
#10 0.670 + local path=/usr/local/containerbase/tools/v2/python.sh
#10 0.670 + check path
#10 0.670 + '[' SET '!=' SET ']'
#10 0.670 + '[' -n '' ']'
#10 0.670 + . //usr/local/containerbase/utils/v2/overrides.sh
#10 0.670 ++ export ROOT_DIR_LEGACY=/usr/local
#10 0.670 ++ ROOT_DIR_LEGACY=/usr/local
#10 0.670 ++ export ROOT_DIR=/opt/containerbase
#10 0.670 ++ ROOT_DIR=/opt/containerbase
#10 0.670 ++ DIR=//usr/local/containerbase/utils/v2
#10 0.670 ++ [[ ! -d //usr/local/containerbase/utils/v2 ]]
#10 0.670 ++ . //usr/local/containerbase/utils/v2/filesystem.sh
#10 0.671 ++ . //usr/local/containerbase/utils/v2/defaults.sh
#10 0.671 + . /usr/local/containerbase/tools/v2/python.sh
#10 0.671 + check_tool_requirements
#10 0.671 + check_semver 3.11.4
#10 0.671 + local version=3.11.4
#10 0.671 + local lowest_component=none
#10 0.671 + [[ ! 3.11.4 =~ ^(0|[1-9][0-9]*)(\.(0|[1-9][0-9]*))?(\.(0|[1-9][0-9]*))?(\+[0-9]+)?([a-z-].*)?$ ]]
#10 0.672 + export MAJOR=3
#10 0.672 + MAJOR=3
#10 0.672 + export MINOR=11
#10 0.672 + MINOR=11
#10 0.672 + export PATCH=4
#10 0.672 + PATCH=4
#10 0.672 + [[ ! none =~ all|major|minor|patch ]]
#10 0.672 + return
#10 0.672 + [[ ! -n 3 ]]
#10 0.672 + [[ ! -n 11 ]]
#10 0.672 + [[ ! -n 4 ]]
#10 0.672 + check_tool_installed
#10 0.672 ++ find_versioned_tool_path
#10 0.672 ++ local tool=python
#10 0.672 ++ local version=3.11.4
#10 0.672 +++ find_tool_path python
#10 0.672 +++ local tools_path
#10 0.673 ++++ get_tools_path
#10 0.673 ++++ local install_dir
#10 0.673 +++++ get_install_dir
#10 0.673 +++++ echo /opt/containerbase
#10 0.673 ++++ install_dir=/opt/containerbase
#10 0.673 ++++ echo /opt/containerbase/tools
#10 0.673 +++ tools_path=/opt/containerbase/tools
#10 0.673 +++ [[ -d /opt/containerbase/tools/python ]]
#10 0.674 +++ echo /opt/containerbase/tools/python
#10 0.675 ++ tool_dir=/opt/containerbase/tools/python
#10 0.675 ++ [[ -d /opt/containerbase/tools/python/3.11.4 ]]
#10 0.675 + test -n ''
#10 0.675 + echo 'installing v2 tool python v3.11.4'
#10 0.675 + install_tool
#10 0.675 installing v2 tool python v3.11.4
#10 0.675 + local tool_path
#10 0.675 + local versioned_tool_path
#10 0.675 + local file
#10 0.675 + local base_url
#10 0.675 + local arch=x86_64
#10 0.675 + local name=python
#10 0.675 + local version=3.11.4
#10 0.675 + local version_codename
#10 0.675 + local checksum_file
#10 0.675 + local expected_checksum
#10 0.675 + local checksum_exists
#10 0.676 ++ find_tool_path
#10 0.676 ++ local tools_path
#10 0.676 +++ get_tools_path
#10 0.676 +++ local install_dir
#10 0.676 ++++ get_install_dir
#10 0.676 ++++ echo /opt/containerbase
#10 0.676 +++ install_dir=/opt/containerbase
#10 0.676 +++ echo /opt/containerbase/tools
#10 0.677 ++ tools_path=/opt/containerbase/tools
#10 0.677 ++ [[ -d /opt/containerbase/tools/python ]]
#10 0.677 ++ echo /opt/containerbase/tools/python
#10 0.677 + tool_path=/opt/containerbase/tools/python
#10 0.677 + [[ ! -d /opt/containerbase/tools/python ]]
#10 0.677 + base_url=https://github.com/containerbase/python-prebuild/releases/download
#10 0.677 ++ get_distro
#10 0.677 ++ require_distro
#10 0.677 ++ local VERSION_CODENAME
#10 0.677 +++ . /etc/os-release
#10 0.677 ++++ NAME=Ubuntu
#10 0.678 ++++ VERSION='20.04.6 LTS (Focal Fossa)'
#10 0.678 ++++ ID=ubuntu
#10 0.678 ++++ ID_LIKE=debian
#10 0.678 ++++ PRETTY_NAME='Ubuntu 20.04.6 LTS'
#10 0.678 ++++ VERSION_ID=20.04
#10 0.678 ++++ HOME_URL=https://www.ubuntu.com/
#10 0.678 ++++ SUPPORT_URL=https://help.ubuntu.com/
#10 0.678 ++++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/
#10 0.678 ++++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy
#10 0.678 ++++ VERSION_CODENAME=focal
#10 0.678 ++++ UBUNTU_CODENAME=focal
#10 0.678 +++ echo focal
#10 0.678 ++ VERSION_CODENAME=focal
#10 0.678 ++ case "$VERSION_CODENAME" in
#10 0.678 +++ . /etc/os-release
#10 0.678 ++++ NAME=Ubuntu
#10 0.678 ++++ VERSION='20.04.6 LTS (Focal Fossa)'
#10 0.678 ++++ ID=ubuntu
#10 0.678 ++++ ID_LIKE=debian
#10 0.678 ++++ PRETTY_NAME='Ubuntu 20.04.6 LTS'
#10 0.678 ++++ VERSION_ID=20.04
#10 0.678 ++++ HOME_URL=https://www.ubuntu.com/
#10 0.678 ++++ SUPPORT_URL=https://help.ubuntu.com/
#10 0.679 ++++ BUG_REPORT_URL=https://bugs.launchpad.net/ubuntu/
#10 0.679 ++++ PRIVACY_POLICY_URL=https://www.ubuntu.com/legal/terms-and-policies/privacy-policy
#10 0.679 ++++ VERSION_CODENAME=focal
#10 0.679 ++++ UBUNTU_CODENAME=focal
#10 0.679 +++ echo focal
#10 0.679 ++ echo focal
#10 0.679 + version_codename=focal
#10 0.679 ++ file_exists https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 0.679 ++ curl -sSLIo /dev/null -w '%{http_code}' https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512      
#10 1.125 + checksum_exists=200
#10 1.125 + [[ 200 == \2\0\0 ]]
#10 1.126 ++ get_from_url https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.126 ++ local url=https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.126 ++ check url true
#10 1.126 ++ '[' SET '!=' SET ']'
#10 1.126 ++ '[' -n true ']'
#10 1.126 ++ '[' -z https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512 ']'
#10 1.126 ++ local checksum
#10 1.126 +++ calculate_checksum https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.126 +++ local text=https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.127 +++ echo https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.127 +++ sha256sum
#10 1.127 +++ awk '{print $1}'
#10 1.128 ++ checksum=7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559
#10 1.128 ++ local name
#10 1.129 +++ basename https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.129 ++ name=python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.129 ++ local expected_checksum
#10 1.129 ++ expected_checksum=
#10 1.129 ++ local checksum_algo
#10 1.129 ++ checksum_algo=
#10 1.129 ++ local filename=7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.129 ++ '[' -n '' ']'
#10 1.129 ++ download_file https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512 7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512 '' ''
#10 1.129 ++ local url=https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.129 ++ check url true
#10 1.130 ++ '[' SET '!=' SET ']'
#10 1.130 ++ '[' -n true ']'
#10 1.130 ++ '[' -z https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512 ']'
#10 1.130 ++ local name
#10 1.130 ++ name=7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.130 ++ local expected_checksum
#10 1.130 ++ expected_checksum=
#10 1.130 ++ local checksum_algo
#10 1.130 ++ checksum_algo=
#10 1.130 ++ local retry=3
#10 1.130 ++ local temp_folder=/tmp
#10 1.130 ++ '[' 3 -gt 0 ']'
#10 1.130 ++ retry=2
#10 1.130 +++ containerbase-cli df https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512 /tmp/7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.602 ++ log='[11:25:57.850] DEBUG (42): discovered distro
#10 1.602     distro: {
#10 1.602       "name": "Ubuntu",
#10 1.602       "versionCode": "focal",
#10 1.602       "versionId": "20.04"
#10 1.602     }
#10 1.602 [11:25:57.852] DEBUG (42): prepare commands
#10 1.602 [11:25:57.854] INFO (42): Downloading file ...
#10 1.602     url: "https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz.sha512"
#10 1.602     output: "/tmp/7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512"
#10 1.602 [11:25:58.235] INFO (42): Download completed  in 381ms.'
#10 1.602 ++ '[' -n '' ']'
#10 1.602 ++ retry=0
#10 1.602 ++ '[' 0 -gt 0 ']'
#10 1.602 ++ echo /tmp/7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.602 + checksum_file=/tmp/7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.603 ++ cat /tmp/7b7df1c67bd3f7e8142f41ab54405735afde829b618b39598fc0b4e59f343559/python-3.11.4-focal-x86_64.tar.xz.sha512
#10 1.603 + expected_checksum=2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba
#10 1.604 ++ get_from_url https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz python-3.11.4-focal-x86_64.tar.xz 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba sha512sum
#10 1.604 ++ local url=https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz
#10 1.604 ++ check url true
#10 1.604 ++ '[' SET '!=' SET ']'
#10 1.604 ++ '[' -n true ']'
#10 1.604 ++ '[' -z https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz ']'
#10 1.604 ++ local checksum
#10 1.604 +++ calculate_checksum https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz
#10 1.604 +++ local text=https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz
#10 1.605 +++ echo https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz
#10 1.605 +++ sha256sum
#10 1.605 +++ awk '{print $1}'
#10 1.606 ++ checksum=0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1
#10 1.606 ++ local name
#10 1.606 ++ name=python-3.11.4-focal-x86_64.tar.xz
#10 1.606 ++ local expected_checksum
#10 1.606 ++ expected_checksum=2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba
#10 1.606 ++ local checksum_algo
#10 1.606 ++ checksum_algo=sha512sum
#10 1.606 ++ local filename=0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 1.606 ++ '[' -n '' ']'
#10 1.606 ++ download_file https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz 0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba sha512sum
#10 1.606 ++ local url=https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz
#10 1.606 ++ check url true
#10 1.606 ++ '[' SET '!=' SET ']'
#10 1.606 ++ '[' -n true ']'
#10 1.606 ++ '[' -z https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz ']'
#10 1.606 ++ local name
#10 1.606 ++ name=0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 1.606 ++ local expected_checksum
#10 1.606 ++ expected_checksum=2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba
#10 1.606 ++ local checksum_algo
#10 1.606 ++ checksum_algo=sha512sum
#10 1.606 ++ local retry=3
#10 1.606 ++ local temp_folder=/tmp
#10 1.606 ++ '[' 3 -gt 0 ']'
#10 1.607 ++ retry=2
#10 1.607 +++ containerbase-cli df https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 7.938 ++ log='[11:25:58.326] DEBUG (58): discovered distro
#10 7.938     distro: {
#10 7.938       "name": "Ubuntu",
#10 7.938       "versionCode": "focal",
#10 7.938       "versionId": "20.04"
#10 7.938     }
#10 7.938 [11:25:58.328] DEBUG (58): prepare commands
#10 7.938 [11:25:58.332] INFO (58): Downloading file ...
#10 7.938     url: "https://github.com/containerbase/python-prebuild/releases/download/3.11.4/python-3.11.4-focal-x86_64.tar.xz"
#10 7.938     output: "/tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz"
#10 7.938 [11:26:04.569] INFO (58): Download completed  in 6.2s.'
#10 7.938 ++ '[' -n 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba ']'
#10 7.938 ++ verify_checksum /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba sha512sum
#10 7.938 ++ local file=/tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 7.938 ++ check file true
#10 7.938 ++ '[' SET '!=' SET ']'
#10 7.938 ++ '[' -n true ']'
#10 7.938 ++ '[' -z /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz ']'
#10 7.938 ++ local expected_checksum=2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba        
#10 7.938 ++ check expected_checksum true
#10 7.938 ++ '[' SET '!=' SET ']'
#10 7.938 ++ '[' -n true ']'
#10 7.938 ++ '[' -z 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba ']'
#10 7.938 ++ local algorithm=sha512sum
#10 7.938 ++ check algorithm true
#10 7.938 ++ '[' SET '!=' SET ']'
#10 7.938 ++ '[' -n true ']'
#10 7.938 ++ '[' -z sha512sum ']'
#10 7.938 ++ case $algorithm in
#10 7.939 +++ sha512sum /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 7.939 +++ cut '-d ' -f1
#10 8.047 ++ real_checksum=2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba
#10 8.047 ++ '[' 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba '!=' 2c009d4aea3d8a3c90128848a2d9979d955127e30a783f78e69ac1757d1e4dd277c6a9b3631364bf71daa8a5692fe1816bc5b561b62d5b08a99fb7e32eca15ba ']'
#10 8.047 ++ return 0
#10 8.047 ++ retry=0
#10 8.047 ++ '[' 0 -gt 0 ']'
#10 8.047 ++ echo /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 8.048 + file=/tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 8.048 + [[ -z /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz ]]
#10 8.048 + bsdtar -C /opt/containerbase/tools/python -xf /tmp/0aa299775304e88f7788c336338e1c9d5c8971f8c565bbb0f2fd48dd176692e1/python-3.11.4-focal-x86_64.tar.xz
#10 11.19 ++ find_versioned_tool_path
#10 11.19 ++ local tool=python
#10 11.19 ++ local version=3.11.4
#10 11.19 +++ find_tool_path python
#10 11.19 +++ local tools_path
#10 11.19 ++++ get_tools_path
#10 11.19 ++++ local install_dir
#10 11.19 +++++ get_install_dir
#10 11.19 +++++ echo /opt/containerbase
#10 11.19 ++++ install_dir=/opt/containerbase
#10 11.19 ++++ echo /opt/containerbase/tools
#10 11.19 +++ tools_path=/opt/containerbase/tools
#10 11.19 +++ [[ -d /opt/containerbase/tools/python ]]
#10 11.19 +++ echo /opt/containerbase/tools/python
#10 11.19 ++ tool_dir=/opt/containerbase/tools/python
#10 11.19 ++ [[ -d /opt/containerbase/tools/python/3.11.4 ]]
#10 11.19 ++ echo /opt/containerbase/tools/python/3.11.4
#10 11.19 + versioned_tool_path=/opt/containerbase/tools/python/3.11.4
#10 11.19 + fix_python_shebangs
#10 11.19 + IFS=
#10 11.19 ++ find /opt/containerbase/tools/python/3.11.4/bin -type f -exec grep -Iq . '{}' ';' -print0
#10 11.19 + read -r -d '' file
#10 11.19 + case "$(head -1 "${file}")" in
#10 11.19 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/pip3.11
#10 11.19 + sed -i '1 s:.*:#\!/opt/containerbase/tools/python/3.11.4\/bin\/python3.11:' /opt/containerbase/tools/python/3.11.4/bin/pip3.11
#10 11.19 + IFS=
#10 11.19 + read -r -d '' file
#10 11.19 + case "$(head -1 "${file}")" in
#10 11.20 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/pydoc3.11
#10 11.20 + sed -i '1 s:.*:#\!/opt/containerbase/tools/python/3.11.4\/bin\/python3.11:' /opt/containerbase/tools/python/3.11.4/bin/pydoc3.11
#10 11.20 + IFS=
#10 11.20 + read -r -d '' file
#10 11.20 + case "$(head -1 "${file}")" in
#10 11.20 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/python3.11-config
#10 11.20 + IFS=
#10 11.20 + read -r -d '' file
#10 11.20 + case "$(head -1 "${file}")" in
#10 11.20 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/pip3
#10 11.20 + sed -i '1 s:.*:#\!/opt/containerbase/tools/python/3.11.4\/bin\/python3.11:' /opt/containerbase/tools/python/3.11.4/bin/pip3
#10 11.21 + IFS=
#10 11.21 + read -r -d '' file
#10 11.21 + case "$(head -1 "${file}")" in
#10 11.21 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/idle3.11
#10 11.21 + sed -i '1 s:.*:#\!/opt/containerbase/tools/python/3.11.4\/bin\/python3.11:' /opt/containerbase/tools/python/3.11.4/bin/idle3.11
#10 11.21 + IFS=
#10 11.21 + read -r -d '' file
#10 11.21 + case "$(head -1 "${file}")" in
#10 11.21 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/2to3-3.11
#10 11.21 + sed -i '1 s:.*:#\!/opt/containerbase/tools/python/3.11.4\/bin\/python3.11:' /opt/containerbase/tools/python/3.11.4/bin/2to3-3.11
#10 11.21 + IFS=
#10 11.21 + read -r -d '' file
#10 11.21 + case "$(head -1 "${file}")" in
#10 11.21 ++ head -1 /opt/containerbase/tools/python/3.11.4/bin/python3.11-gdb.py
#10 11.21 + sed -i '1 s:.*:#\!/opt/containerbase/tools/python/3.11.4\/bin\/python:' /opt/containerbase/tools/python/3.11.4/bin/python3.11-gdb.py
#10 11.21 + IFS=
#10 11.21 + read -r -d '' file
#10 11.21 + PIP_ROOT_USER_ACTION=ignore
#10 11.21 + PIP_USE_PEP517=true
#10 11.21 + /opt/containerbase/tools/python/3.11.4/bin/python -W ignore -m pip install --compile --no-warn-script-location --no-cache-dir --quiet --upgrade pip virtualenv   
#10 11.78   WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /packages/50/c2/e06851e8cc28dcad7c155f4753da8833ac06a5c704c109313b8d5a62968a/pip-23.2.1-py3-none-any.whl
#10 12.34   WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /packages/50/c2/e06851e8cc28dcad7c155f4753da8833ac06a5c704c109313b8d5a62968a/pip-23.2.1-py3-none-any.whl
#10 13.39   WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /packages/50/c2/e06851e8cc28dcad7c155f4753da8833ac06a5c704c109313b8d5a62968a/pip-23.2.1-py3-none-any.whl
#10 15.44   WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /packages/50/c2/e06851e8cc28dcad7c155f4753da8833ac06a5c704c109313b8d5a62968a/pip-23.2.1-py3-none-any.whl
#10 19.52   WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)'))': /packages/50/c2/e06851e8cc28dcad7c155f4753da8833ac06a5c704c109313b8d5a62968a/pip-23.2.1-py3-none-any.whl
#10 19.57 ERROR: Could not install packages due to an OSError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Max retries exceeded with url: /packages/50/c2/e06851e8cc28dcad7c155f4753da8833ac06a5c704c109313b8d5a62968a/pip-23.2.1-py3-none-any.whl (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1002)')))
#10 19.57
#10 19.64 [11:26:16.278] FATAL (1): Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4
#10 19.64     err: {
#10 19.64       "type": "Error",
#10 19.64       "message": "Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4",
#10 19.64       "stack":
#10 19.64           Error: Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4
#10 19.64               at makeError (/snapshot/dist/containerbase-cli.js:40984:13)
#10 19.64               at handlePromise (/snapshot/dist/containerbase-cli.js:41440:29)
#10 19.64               at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
#10 19.64               at async InstallLegacyToolService.execute (/snapshot/dist/containerbase-cli.js:42519:5)
#10 19.64               at async InstallToolService.execute (/snapshot/dist/containerbase-cli.js:42689:7)
#10 19.64               at async InstallToolShortCommand.execute (/snapshot/dist/containerbase-cli.js:42767:14)
#10 19.64               at async InstallToolShortCommand.validateAndExecute (/snapshot/dist/containerbase-cli.js:1342:26)
#10 19.64               at async _Cli.run (/snapshot/dist/containerbase-cli.js:2455:22)
#10 19.64               at async _Cli.runExit (/snapshot/dist/containerbase-cli.js:2463:28)
#10 19.64               at async main (/snapshot/dist/containerbase-cli.js:42927:3)
#10 19.64       "shortMessage": "Command failed with exit code 1: /usr/local/containerbase/bin/install-tool python 3.11.4",
#10 19.64       "command": "/usr/local/containerbase/bin/install-tool python 3.11.4",
#10 19.64       "escapedCommand": "\"/usr/local/containerbase/bin/install-tool\" python 3.11.4",
#10 19.64       "exitCode": 1,
#10 19.64       "failed": true,
#10 19.64       "timedOut": false,
#10 19.64       "isCanceled": false,
#10 19.64       "killed": false
#10 19.64     }
#10 19.64 [11:26:16.279] INFO (1): Installed tool python with errors in 18.9s.
------
executor failed running [/bin/bash -c install-tool python 3.11.4]: exit code: 1

1 reply

viceice Aug 9, 2023
Maintainer

strange, it's definitely pip which is failing with SSL error. 🤔

we probably need to google about the issue because I've no idea what's wrong.

can you do some more test?

FROM renovate/renovate

USER 0
COPY cert.pem /usr/local/share/ca-certificates/my-root-ca.crt
RUN update-ca-certificates


RUN install-apt python pip
RUN pip install --upgrade pip virtualenv

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Install python and pip behind corporate proxy #1687

{{title}}

Replies: 7 comments 1 reply

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Install python and pip behind corporate proxy #1687

y0x Aug 8, 2023

Replies: 7 comments · 1 reply

viceice Aug 8, 2023 Maintainer

viceice Aug 8, 2023 Maintainer

viceice Aug 8, 2023 Maintainer

y0x Aug 9, 2023 Author

viceice Aug 9, 2023 Maintainer

viceice Aug 9, 2023 Maintainer

y0x Aug 9, 2023 Author

viceice Aug 9, 2023 Maintainer

y0x
Aug 8, 2023

Replies: 7 comments 1 reply

viceice
Aug 8, 2023
Maintainer

viceice
Aug 8, 2023
Maintainer

viceice
Aug 8, 2023
Maintainer

y0x
Aug 9, 2023
Author

viceice
Aug 9, 2023
Maintainer

viceice
Aug 9, 2023
Maintainer

y0x
Aug 9, 2023
Author

viceice Aug 9, 2023
Maintainer