Only a few deploy to gh-pages jobs are successful, cannot lock ref

[SooluThomas]

Describe the Issue

I keep getting

Error: The deploy step encountered an error: The process '/usr/bin/git' failed with exit code 1 ❌
Deployment failed! ❌

Logs

Additional Comments

I have reported this in #365 (comment)

[JamesIves]

Please post your workflow

[SooluThomas]

on:
  pull_request:
    branches: [ master ]
  label:
     types: [ gh-pages ]

jobs:
  build:
    runs-on: ubuntu-latest
    strategy:
      matrix:
        language: [de_DE, ja_JP, es_ES]
    if: contains( github.event.pull_request.labels.*.name, 'gh-pages' )
    steps:
    - uses: actions/checkout@v2

    - name: Cancel previous Runs
      uses: everphone-gmbh/cancel-previous-workflows@v5

    - name: Set up Python
      uses: actions/setup-python@v2
      with:
        python-version: '3.8'

    - name: Install dependencies
      run: |
        python -m pip install --upgrade pip
        pip install -U virtualenv setuptools wheel
        pip install -U -r requirements-dev.txt sphinx-intl qiskit
        sudo apt-get install graphviz pandoc
    - name: Build translated Qiskit Docs
      env:
        TRANSLATION_LANG: ${{ matrix.language }}
      run: |
        tools/staging_translated_documentation.sh
    - name: Install SSH Client
      uses: webfactory/ssh-agent@v0.2.0
      with:
          ssh-private-key: ${{ secrets.GH_PAGES_DEPLOY_KEY }}

    - name: Deploy to gh-pages
      uses: JamesIves/github-pages-deploy-action@3.5.9
      with:
        BASE_BRANCH: master
        BRANCH: gh-pages
        FOLDER: build
        CLEAN_EXCLUDE: '["README.md", "index.html", "qiskit_header.png"]'
        ACTIONS_STEP_DEBUG: true
        SSH: true

[JamesIves]

Couple of things:

• Update to the latest version. 3.6.2 is the latest.
• When does this occur, when you tag something or on commit to the main branch?
• Can you also provide a full copy of the logs?
• When did this start, is this a more recent issue or ongoing?
• Are you firing off multiple work flows at once (looking at your config you could have duplicate triggers). This could cause problems and result in the error you’re seeing.

Moved this to discussions until we can figure out if this is a bug or not or an issue with your workflow.

[SooluThomas]

Hi James,

I bumped the version to 3.6.2 (https://github.com/qiskit-community/qiskit-translations/pull/276/checks?check_run_id=1289660833). So, the build is triggered if a label gh-pages is added to a PR and basically, this errors randomly. Initially I had all the builds in a single workflow but then broke it down to 4 different files because I had to re-run the sphinx docs build for all 11 languages which I felt was unnecessary. But anyways, it still fails.
In the link above, I added everything to a single workflow (https://github.com/qiskit-community/qiskit-translations/blob/b549d008c0f0a124eae7a0e1503bb50387fdf6f1/.github/workflows/staging-workflow.yml)

This has been happening after increasing the number of jobs in the single workflow. But I've been struggling with this error since few months now.

[tojon]

Like, does this mean I can specify a file from the ReadMe?

file: "You can also utilize absolute file paths by appending ~ to your folder path."

[tojon]

Ooh, or maybe I can do this:

https://www.r-bloggers.com/2020/07/running-github-actions-sequentially/
Sequential jobs: Set max-parallel: 1 within the jobs.strategy element of the workflow.

[tojon]

Right, so that part worked ^ preventing deployment collisions by the separate jobs. They are now sequential. However since the deployment/ directory structure I'm trying to generate and I'm iterating over is like this:

deployment/dirA/fileA.ext
deployment/dirA/fileB.ext
deployment/dirB/fileA.ext
deployment/dirB/fileB.ext
deployment/dirB/fileC.ext

When Jame's (super awesome) deployment action runs, files 1-4 are obliterated with each subsequent action and the deployment is triggered each time. I only end up with deployment/dirB/fileC.ext in my gh-pages repo tree that I'm hosting the deployment in.

So my thinking is I'd like to deploy just the file, in each job run, rather than the parent folder. Is there a way to do that? Or "preserve" unchanged files already in the gh-pages repo? Thoughts?

[tojon]

Actually, now that I look at it, I think I want to do a for loop inside a single job steps context. Then this deployment problem goes away, since all the files A,B,A,B,C will be built in a single job, and @JamesIves deployment will deploy them all in one shot. I'll see if I can figure out how to do that.

[tojon]

I couldn't seem to find any way to do a for loop with GitHub Actions (I'm a relative newbie but I looked a ton in the hive mind, SO, etc). Basically I gave up - and made a big ugly block of repeated code blocks for each file, until such time as actions supports for loops.