Error Building AlphaPose in Linux

[JamesMcCullochDickens]

I am following the install.md docs and getting the following error during my build:

My OS is Ubuntu 22.04.

Error compiling Cython file:

...

distutils: language = c

^

halpecocotools/_mask.pyx:1:0: Compiler crash in RemoveUnreachableCode

ModuleNode.body = StatListNode(_mask.pyx:1:0)

Compiler crash traceback from this point on:
File "Cython/Compiler/Visitor.py", line 182, in Cython.Compiler.Visitor.TreeVisitor._visit
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Compiler/ParseTreeTransforms.py", line 3112, in visit_StatListNode
if not self.current_directives['remove_unreachable']:
TypeError: 'NoneType' object is not subscriptable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "setup.py", line 214, in
zip_safe=False)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/init.py", line 107, in setup
return distutils.core.setup(**attrs)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/develop.py", line 34, in run
self.install_for_development()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/develop.py", line 126, in install_for_development
self.process_distribution(None, self.dist, not self.no_deps)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 751, in process_distribution
[requirement], self.local_index, self.easy_install
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/pkg_resources/init.py", line 830, in resolve
req, best, replace_conflicting, env, installer, required_by, to_activate
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/pkg_resources/init.py", line 866, in _resolve_dist
req, ws, installer, replace_conflicting=replace_conflicting
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/pkg_resources/init.py", line 1135, in best_match
return self.obtain(req, installer)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/pkg_resources/init.py", line 1147, in obtain
return installer(requirement)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 677, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 703, in install_item
dists = self.install_eggs(spec, download, tmpdir)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 896, in install_eggs
return self.build_and_install(setup_script, setup_base)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 1170, in build_and_install
self.run_setup(setup_script, setup_base, args)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/easy_install.py", line 1154, in run_setup
run_setup(setup_script, args)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 262, in run_setup
raise
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/contextlib.py", line 130, in exit
self.gen.throw(type, value, traceback)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 198, in setup_context
yield
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/contextlib.py", line 130, in exit
self.gen.throw(type, value, traceback)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 169, in save_modules
saved_exc.resume()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 143, in resume
raise exc.with_traceback(self._tb)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 156, in save_modules
yield saved
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 198, in setup_context
yield
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 259, in run_setup
_execfile(setup_script, ns)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/sandbox.py", line 46, in _execfile
exec(code, globals, locals)
File "/tmp/easy_install-9pxyloow/halpecocotools-0.0.0/setup.py", line 28, in
def _minimal_ext_cmd(cmd):
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/init.py", line 107, in setup
return distutils.core.setup(**attrs)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/bdist_egg.py", line 164, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/bdist_egg.py", line 150, in call_command
self.run_command(cmdname)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/command/install_lib.py", line 111, in build
self.run_command('build_ext')
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/dist.py", line 1234, in run_command
super().run_command(command)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
self.build_extensions()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
self._build_extensions_serial()
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
self.build_extension(ext)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/setuptools/command/build_ext.py", line 246, in build_extension
_build_ext.build_extension(self, ext)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Distutils/build_ext.py", line 131, in build_extension
ext,force=self.force, quiet=self.verbose == 0, **options
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Build/Dependencies.py", line 1154, in cythonize
cythonize_one(*args)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Build/Dependencies.py", line 1300, in cythonize_one
result = compile_single(pyx_file, options, full_module_name=full_module_name)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Compiler/Main.py", line 615, in compile_single
return run_pipeline(source, options, full_module_name)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Compiler/Main.py", line 539, in run_pipeline
err, enddata = Pipeline.run_pipeline(pipeline, source)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Compiler/Pipeline.py", line 398, in run_pipeline
data = run(phase, data)
File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Compiler/Pipeline.py", line 375, in run
return phase(data)
File "Cython/Compiler/Visitor.py", line 312, in Cython.Compiler.Visitor.CythonTransform.call
File "Cython/Compiler/Visitor.py", line 294, in Cython.Compiler.Visitor.VisitorTransform.call
File "Cython/Compiler/Visitor.py", line 184, in Cython.Compiler.Visitor.TreeVisitor._visit
File "Cython/Compiler/Visitor.py", line 182, in Cython.Compiler.Visitor.TreeVisitor._visit
File "Cython/Compiler/Visitor.py", line 322, in Cython.Compiler.Visitor.CythonTransform.visit_Node
File "Cython/Compiler/Visitor.py", line 260, in Cython.Compiler.Visitor.VisitorTransform._process_children
File "Cython/Compiler/Visitor.py", line 227, in Cython.Compiler.Visitor.TreeVisitor._visitchildren
File "Cython/Compiler/Visitor.py", line 196, in Cython.Compiler.Visitor.TreeVisitor._visitchild
File "Cython/Compiler/Visitor.py", line 190, in Cython.Compiler.Visitor.TreeVisitor._visit
File "Cython/Compiler/Visitor.py", line 148, in Cython.Compiler.Visitor.TreeVisitor._raise_compiler_error
setuptools.sandbox.UnpickleableException: CompilerCrash((FileSourceDescriptor:/tmp/easy_install-9pxyloow/halpecocotools-0.0.0/halpecocotools/_mask.pyx, 1, 0), 'RemoveUnreachableCode', 'Compiler crash in RemoveUnreachableCode\n\nModuleNode.body = StatListNode(_mask.pyx:1:0)\n\nCompiler crash traceback from this point on:\n File "Cython/Compiler/Visitor.py", line 182, in Cython.Compiler.Visitor.TreeVisitor._visit\n File "/home/james/anaconda3/envs/alphapose_r/lib/python3.7/site-packages/Cython/Compiler/ParseTreeTransforms.py", line 3112, in visit_StatListNode\n if not self.current_directives['remove_unreachable']:\nTypeError: 'NoneType' object is not subscriptable', TypeError("'NoneType' object is not subscriptable"), <traceback object at 0x7efb9e25e370>

The exact instructions I followed were as follows:

Get CUDA

sudo apt update
sudo apt install nvidia-cuda-toolkit

1. Create a conda virtual environment.

conda create -n alphapose python=3.7 -y
conda activate alphapose

2. Install PyTorch

conda install pytorch==1.12.1 torchvision==0.13.1 torchaudio==0.12.1 cudatoolkit=11.3 -c pytorch

3. Get AlphaPose

git clone https://github.com/MVIG-SJTU/AlphaPose.git
cd AlphaPose

4. install

export PATH=/usr/local/cuda/bin/:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda/lib64/:$LD_LIBRARY_PATH
pip install -U pip setuptools
python -m pip install cython
sudo apt-get install libyaml-dev
python setup.py build develop

[JamesL404]

I have the same issue, did you fix it?

[JamesMcCullochDickens]

@JamesL404 This for me is working so far:
// Create a conda virtual environment.
conda create -n alphapose python=3.7 -y
conda activate alphapose
conda install -c "nvidia/label/cuda-11.3.1" cuda-toolkit -y

// 2. Install PyTorch
conda install pytorch torchvision torchaudio pytorch-cuda=11.3 -c pytorch -c nvidia

// Get AlphaPose
git clone https://github.com/MVIG-SJTU/AlphaPose.git
cd AlphaPose

// install
export PATH=/usr/local/cuda/bin/:$PATH
export LD_LIBRARY_PATH=/usr/local/cuda/lib64/:$LD_LIBRARY_PATH
pip install -U pip setuptools
pip install cython==0.27.3
sudo apt-get install libyaml-dev
pip install easydict halpecocotools munkres natsort opencv-python pyyaml scipy tensorboardx terminaltables timm==0.1.20 tqdm visdom jinja2 typeguard
python setup.py build develop

// Install PyTorch3D (Optional, only for visualization)
conda install -c fvcore -c iopath -c conda-forge fvcore iopath -y
conda install -c bottler nvidiacub -y
pip install pytorch3d

A couple of additional thoughts. I am using gcc 9.5, and Ubuntu 22.04. The two most important fixes in this different set of installation instructions was the cython version as well as the cuda toolkit version used (not part of PyTorch, but a separate install).

If you have gcc issues, checkout:
#1157 (comment)

[JamesL404]

it works, I think Cython version is the main issue, thanks!

[avegetablechicken]

@JamesL404 This for me is working so far: // Create a conda virtual environment. conda create -n alphapose python=3.7 -y conda activate alphapose conda install -c "nvidia/label/cuda-11.3.1" cuda-toolkit -y

// 2. Install PyTorch conda install pytorch torchvision torchaudio pytorch-cuda=11.3 -c pytorch -c nvidia

// Get AlphaPose git clone https://github.com/MVIG-SJTU/AlphaPose.git cd AlphaPose

// install export PATH=/usr/local/cuda/bin/:$PATH export LD_LIBRARY_PATH=/usr/local/cuda/lib64/:$LD_LIBRARY_PATH pip install -U pip setuptools pip install cython==0.27.3 sudo apt-get install libyaml-dev pip install easydict halpecocotools munkres natsort opencv-python pyyaml scipy tensorboardx terminaltables timm==0.1.20 tqdm visdom jinja2 typeguard python setup.py build develop

// Install PyTorch3D (Optional, only for visualization) conda install -c fvcore -c iopath -c conda-forge fvcore iopath -y conda install -c bottler nvidiacub -y pip install pytorch3d

A couple of additional thoughts. I am using gcc 9.5, and Ubuntu 22.04. The two most important fixes in this different set of installation instructions was the cython version as well as the cuda toolkit version used (not part of PyTorch, but a separate install).

If you have gcc issues, checkout: #1157 (comment)

Exactly followed your commands and it worked for Ubuntu18.04. Thanks!

[benrubin]

Hi @JamesMcCullochDickens and @JamesL404 -- I'm having all kinds of similar installation problems (Ubuntu 20.04). I'm happy to see that you are both getting this to work! I'm now stepping through the instructions above, but I'm stuck on step 2. I'm hoping you can help!

When I run
$ conda install pytorch torchvision torchaudio pytorch-cuda=11.3 -c pytorch -c nvidia

I get this:

PackagesNotFoundError: The following packages are not available from current channels:
  - pytorch-cuda=11.3

Current channels:

  - https://conda.anaconda.org/pytorch/linux-64
  - https://conda.anaconda.org/pytorch/noarch
  - https://conda.anaconda.org/nvidia/linux-64
  - https://conda.anaconda.org/nvidia/noarch
  - https://aws-ml-conda-ec2.s3.us-west-2.amazonaws.com/linux-64
  - https://aws-ml-conda-ec2.s3.us-west-2.amazonaws.com/noarch
  - https://conda.anaconda.org/conda-forge/linux-64
  - https://conda.anaconda.org/conda-forge/noarch

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.

I've searched for pytorch-cuda=11.3 on https://anaconda.org, but no luck.

Any advice?

[JamesMcCullochDickens]

@benrubin
try:
conda install pytorch==1.12.1 torchvision==0.13.1 torchaudio==0.12.1 cudatoolkit=11.3 -c pytorch

You can see conda commands to install previous versions here, you just need to make sure you use cudatoolkit 11.3.
https://pytorch.org/get-started/previous-versions/

[benrubin]

Wow -- installed without errors at last!
Thank you so much.
Now comes the real work.

[anas-zafar]

@JamesL404 I followed your instructions, I am facing this issue when I run the train command

from . import nms_cpu, nms_cuda
ImportError: /home/train/Desktop/AlphaPose/detector/nms/nms_cpu.cpython-37m-x86_64-linux-gnu.so: undefined symbol: _ZN6caffe28TypeMeta21_typeMetaDataInstanceIdEEPKNS_6detail12TypeMetaDataEv

Can you please guide me what am I doing wrong? Thanks