"WARNING: No metadata found in ..." when trying to re-install a package from git in existing environment

[alexmelekhin]

I want to run tests that require package MinkowskiEngine that should be build and installed from git with the command pip install git+https://github.com/NVIDIA/MinkowskiEngine --no-deps. I do it with a command session.install("git+https://github.com/NVIDIA/MinkowskiEngine", "--no-deps", silent=False).

If run session with command nox -s "tests(python='3.8', pytorch='1.12.1')" everything works fine, but if I add -r flag to save time, the session.install of MinkowskiEngine works in a strange way: every odd (first, third, and so on) attempt is successful, but every even (second, fourth, and so on) does not even start an installation of the package with a WARNING: No metadata found in ./.nox/tests-python-3-8-pytorch-1-12-1/lib/python3.8/site-packages.

The session code:

ef install_cpu_torch(session: Session, pytorch: str = "1.12.1") -> None:
    """Install the CPU version of PyTorch."""
    session.install(
        f"torch=={pytorch}+cpu",
        f"torchvision=={TORCHVISION_VERSIONS_DICT[pytorch]}+cpu",
        "--extra-index-url",
        "https://download.pytorch.org/whl/cpu",
    )


def install_minkowskiengine(session: Session) -> None:
    """Install the MinkowskiEngine."""
    session.install("setuptools==68.0.0")
    session.install("git+https://github.com/NVIDIA/MinkowskiEngine", "--no-deps", silent=False)


@nox.session
@nox.parametrize(
    "python,pytorch",
    [
        (python, pytorch)
        for python in PYTHON_VERSIONS
        for pytorch in PYTORCH_VERSIONS
        if (python, pytorch) not in (("3.11", "1.12.1"), ("3.11", "1.13.1"))
    ],
)
def tests(session: Session, pytorch: str) -> None:
    """Run the test suite."""
    args = session.posargs or ["--cov"]
    install_cpu_torch(session, pytorch)
    install_minkowskiengine(session)
    session.install("-e", ".")
    session.install("-r", "requirements-dev.txt")
    session.run("pytest", *args)

First time I run the session with the command nox -rs "tests(python='3.8', pytorch='1.12.1')":

docker_opr@cdsmelekhin:~/OpenPlaceRecognition$ nox -rs "tests(python='3.8', pytorch='1.12.1')"                                                                                                                     
nox > Running session tests(python='3.8', pytorch='1.12.1')                                                                                                                                                        
nox > Re-using existing virtual environment at .nox/tests-python-3-8-pytorch-1-12-1.                                                                                                                               
nox > python -m pip install torch==1.12.1+cpu torchvision==0.13.1+cpu --extra-index-url https://download.pytorch.org/whl/cpu                                                                                       
nox > python -m pip install setuptools==68.0.0                                                                                                                                                                     
nox > python -m pip install git+https://github.com/NVIDIA/MinkowskiEngine --no-deps                                                                                                                                
Collecting git+https://github.com/NVIDIA/MinkowskiEngine                                                                                                                                                           
  Cloning https://github.com/NVIDIA/MinkowskiEngine to /tmp/pip-req-build-dj0k6vhz                                                                                                                                 
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA/MinkowskiEngine /tmp/pip-req-build-dj0k6vhz                                                                                       
  Resolved https://github.com/NVIDIA/MinkowskiEngine to commit 02fc608bea4c0549b0a7b00ca1bf15dee4a0b228                                                                                                            
  Preparing metadata (setup.py) ... done                                                                                                                                                                           
Building wheels for collected packages: MinkowskiEngine                                                                                                                                                            
  Building wheel for MinkowskiEngine (setup.py) ... done                                                                                                                                                           
  Created wheel for MinkowskiEngine: filename=MinkowskiEngine-0.5.4-cp38-cp38-linux_x86_64.whl size=19579787 sha256=800bb113237973130ae7f88b9a9f0aa43e7a09a055c4b77dcc492c12cabb6230                               
  Stored in directory: /tmp/pip-ephem-wheel-cache-bxsqg_tx/wheels/38/a5/f0/d4be769dc2bfcfc6e424c1d797548f033ad742d891a2365a17                                                                                      
Successfully built MinkowskiEngine                                                                                                                                                                                 
Installing collected packages: MinkowskiEngine                                                                                                                                                                     
Successfully installed MinkowskiEngine-0.5.4                                                                                                                                                                       
nox > python -m pip install -e .                                                                                                                                                                                   
nox > python -m pip install -r requirements-dev.txt                                                                                                                                                                
nox > pytest --cov                                                                                                                                                                                                 
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.8.10, pytest-7.4.0, pluggy-1.2.0                                                                                                                                                        
rootdir: /home/docker_opr/OpenPlaceRecognition                                                                                                                                                                     
plugins: cov-4.1.0, hydra-core-1.3.2, typeguard-3.0.2
collected 3 items                                                                                                                                                                                                 

tests/test_const.py .                                                                                                                                                                                       [ 33%]
tests/test_utils.py .                                                                                                                                                                                       [ 66%]
tests/models/place_recognition/test_minkloc3d.py .                                                                                                                                                          [100%]

================================================================================================ warnings summary =================================================================================================

<some warnings unrelated to the problem>

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

---------- coverage: platform linux, python 3.8.10-final-0 -----------
Name                                               Stmts   Miss  Cover
----------------------------------------------------------------------
src/opr/__init__.py                                    5      2    60%
src/opr/const.py                                      17      0   100%
src/opr/layers/eca.py                                 37     26    30%
src/opr/layers/gem.py                                 34     13    62%
src/opr/models/__init__.py                             0      0   100%
src/opr/models/place_recognition/__init__.py           1      0   100%
src/opr/models/place_recognition/minkloc3d.py        147     63    57%
src/opr/utils.py                                      73     52    29%
tests/__init__.py                                      0      0   100%
tests/models/place_recognition/test_minkloc3d.py      12      0   100%
tests/test_const.py                                   17      0   100%
tests/test_utils.py                                   16      0   100%
----------------------------------------------------------------------
TOTAL                                                359    156    57%

========================================================================================= 3 passed, 16 warnings in 0.78s ==========================================================================================
nox > Session tests(python='3.8', pytorch='1.12.1') was successful.

The next time with the same nox -rs "tests(python='3.8', pytorch='1.12.1')":

docker_opr@cdsmelekhin:~/OpenPlaceRecognition$ nox -rs "tests(python='3.8', pytorch='1.12.1')"                                                                                                                     
nox > Running session tests(python='3.8', pytorch='1.12.1')                                                                                                                                                        
nox > Re-using existing virtual environment at .nox/tests-python-3-8-pytorch-1-12-1.                                                                                                                               
nox > python -m pip install torch==1.12.1+cpu torchvision==0.13.1+cpu --extra-index-url https://download.pytorch.org/whl/cpu                                                                                       
nox > python -m pip install setuptools==68.0.0                                                                                                                                                                     
nox > python -m pip install git+https://github.com/NVIDIA/MinkowskiEngine --no-deps                                                                                                                                
Collecting git+https://github.com/NVIDIA/MinkowskiEngine                                                                                                                                                           
  Cloning https://github.com/NVIDIA/MinkowskiEngine to /tmp/pip-req-build-vs_8qkay
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA/MinkowskiEngine /tmp/pip-req-build-vs_8qkay
  Resolved https://github.com/NVIDIA/MinkowskiEngine to commit 02fc608bea4c0549b0a7b00ca1bf15dee4a0b228
  Preparing metadata (setup.py) ... done
WARNING: No metadata found in ./.nox/tests-python-3-8-pytorch-1-12-1/lib/python3.8/site-packages
nox > python -m pip install -e .
nox > python -m pip install -r requirements-dev.txt
nox > pytest --cov
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.8.10, pytest-7.4.0, pluggy-1.2.0
rootdir: /home/docker_opr/OpenPlaceRecognition
plugins: cov-4.1.0, hydra-core-1.3.2, typeguard-3.0.2
collected 2 items / 1 error                                                                                                                                                                                       

===================================================================================================== ERRORS ======================================================================================================
________________________________________________________________________ ERROR collecting tests/models/place_recognition/test_minkloc3d.py ________________________________________________________________________
ImportError while importing test module '/home/docker_opr/OpenPlaceRecognition/tests/models/place_recognition/test_minkloc3d.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/usr/lib/python3.8/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
tests/models/place_recognition/test_minkloc3d.py:8: in <module>
    from opr.models.place_recognition.minkloc3d import MinkLoc3D
src/opr/models/place_recognition/__init__.py:2: in <module>
    from .minkloc3d import MinkLoc3D
src/opr/models/place_recognition/minkloc3d.py:11: in <module>
    import MinkowskiEngine as ME
E   ModuleNotFoundError: No module named 'MinkowskiEngine'

---------- coverage: platform linux, python 3.8.10-final-0 -----------
Name                                               Stmts   Miss  Cover
----------------------------------------------------------------------
src/opr/__init__.py                                    5      2    60%
src/opr/const.py                                      17      5    71%
src/opr/models/__init__.py                             0      0   100%
src/opr/models/place_recognition/__init__.py           1      0   100%
src/opr/models/place_recognition/minkloc3d.py        147    145     1%
src/opr/utils.py                                      73     62    15%
tests/__init__.py                                      0      0   100%
tests/models/place_recognition/test_minkloc3d.py      12      7    42%
tests/test_const.py                                   17     11    35%
tests/test_utils.py                                   16     12    25%
----------------------------------------------------------------------
TOTAL                                                288    244    15%

============================================================================================= short test summary info =============================================================================================
ERROR tests/models/place_recognition/test_minkloc3d.py
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
================================================================================================ 1 error in 0.75s =================================================================================================
nox > Command pytest --cov failed with exit code 2
nox > Session tests(python='3.8', pytorch='1.12.1') failed.

And if I run the same command in the third time it will complete successfully like in the first attempt. So, every odd attempt is successful, and every even is not.

How can I fix it and make session behaviour stable?