You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description
Some buffer memory not get freed after the device is dropped.
In the picture above, I load the same amount of data twice. Between the loads I drop the adapter, the device and all the buffers. However it seems that there are still some GPU memory not freed.
Expected vs observed behavior
Expected: The two loads take the same amount of GPU memory.
Observed: The later load takes more memory, and if repeating the process you will get an OOM.
before dropping, it gets mitigated, but each reload still adds 0.2GB.
ErichDonGubler
changed the title
Some buffer memory not get freed after the device is dropped
Some buffer memory does not get freed after the device is dropped
May 13, 2024
@cryscan Thanks for the bug report and the analysis!
Do the issues you linked (#3518, #3498) exhibit the same behavior on your system? It is extremely valuable for us to have a test case that can reproduce the issue.
Description
Some buffer memory not get freed after the device is dropped.
In the picture above, I load the same amount of data twice. Between the loads I drop the adapter, the device and all the buffers. However it seems that there are still some GPU memory not freed.
Expected vs observed behavior
Platform
The text was updated successfully, but these errors were encountered: