Sleep in Catalina does not work with unused GFX in pc.

Hi

So im kinda forced to update soon, so im working on getting my catalina build working and moving on from Nvidia.

I almost have sleep working, i just have a minor issue. If i have my graphics card in the PC, then sleep will not be working. However if i take it out sleep will be working just fine.

What i can read online it might have something to do with HDMI ports making a kernal panic - however i cannot find a way to fix this.

I hope some one can help

My system is: I5 - 8600k UHD 360 GTX 970 (not being used) Z370-A pro motherboard Omni soundblaster 5.1 for sound