Boots but gpu stuck on bootscreen

I use a kvm and pass through my gpu to macos but the gpu is the issue so it should be the same for real hardware aswell.

So when I use macOS without the gpu (software rendering), it boots fine although the wallpaper is white.

When booting with gpu passthrough I get stuck in the boot logs between +2 and +4 lines after "sleep s3 s4 s5" then after a couple of minutes, maybe when os goes to sleep i think the framebuffer or something refreshes and the start screen shows, also any apps if reopen apps is enabled. When I turned off sleep it was stuck on boot logs forever

GPU passthrough works and windows flawlessly btw

What ive tried: disabling s3 sleep

Any help is really appreciated

GPU: RX580 8GB deviceid: 1002 67DF - 1DA2 E353 Boardid: 113-4E353BU-O6Q