Building dependencies

The shell scripts executed by the pod (present at the tool root) automatically create a virtual environment each time a Kubernetes pod is created and installs the dependencies from requirements.txt. First it proceeds with the installation and then execs the Python script upon completion of installation. The dependencies of parsebot are stored in requirements-parsebot.txt and dependencies of the web app are stored in requirements-web.txt.

Issues

For some dependencies, building with setup.py in Toolforge may fail with error: invalid command 'bdist_wheel'. This problem can be resolved by installing and upgrading setuptools and wheel before proceeding to install other dependencies, like:

$ pip3 install --upgrade setuptools wheel

The shell script handles this automatically. Remember to not install the dependencies from the --user context as it get installed to a path not specified in PATH, requiring more configuration.