amd graphics – opencl unusable due to low vram (AMD APU)

I have an AMD APU in my laptop and the bios assigns it 512M of vram in the bios. (no way to change it, the apu is a ryzen 7 4700u)
I am currently using amdgpu 21.30 drivers (rocr opencl) on ubuntu 21.04.
This used to work find on windows since the opencl driver would use and detect shared memory, but for some reason on linux, rocr dosen’t seem to care about shared memory. Is there any way to let rocr use shared memory or create a swapfile that acts as vram?