failed to setup container for group 51: memory listener initialization failed

[wizardyjh]

I got an error when i run a kata container with gpu passthrough:

command:

nerdctl run --runtime "io.containerd.kata.v2" --mount type=bind,src=/dev,dest=/dev --privileged=true --security-opt privileged-without-host-devices --device /dev/vfio/51 --name=test -d ubuntu:latest

error:
failed to create shim task:QMP command failed:vfio 0000:ca:00.0: failed to setup container for group 51: memory listener initialization failed:Region dimm1:vfio_dma_map(0x55555774cdc0,0x100000000,0x1380000000,0x7f87b3ffe000)=-14(Bad address):unknown

containerd:1.7.2
kata:2.5.2

the host has 128G memory,if i set 'default_memory' > 62G , it report error

[zvonkok]

Are you saying that it works with default_memory < 62G ?

[zvonkok]

Any reason you're doing these flags? --mount type=bind,src=/dev,dest=/dev --privileged=true

[wizardyjh]

Are you saying that it works with default_memory < 62G ?

yes

[wizardyjh]

Any reason you're doing these flags? --mount type=bind,src=/dev,dest=/dev --privileged=true

This is not necessary, but remove these don't change the result.
thanks！

[zvonkok]

Are you using OVMF or the default empty setting? Can you share your config.toml ?

[wizardyjh]

@zvonkok

[zvonkok]

Any chance you can use a newer Kata release? We've done a lot of fixes for Kata 3.xx

[wizardyjh]

Any chance you can use a newer Kata release? We've done a lot of fixes for Kata 3.xx

not work on kata 3.4

[zvonkok]

What are your bios settings, ACS, Iommu and Virt enabled? What is your kernel commandline?

[wizardyjh]

@zvonkok