Bluetooth not working after boot

I’ve got a very weird bug with my build. I’m using an ASRock Deskmini 310W with Intel Core i5 8500 with 2x8gb Ram. For WiFi/BT I’m using a BCM943602CS card with one of these adapters https://www.ebay.com.au/itm/BCM94360CD-BCM94360CS2-BCM943224PCIEBT2-Card-To-M-2-Key-A-E-Cable-For-Mac-OS/202816949410

So here’s the issue. The magic keyboard and trackpad are paired and start working as soon as I boot up. It works in the BIOS and also works fine at the Keyvault password screen. Once I enter the password and the OS show up (after the Apple logo) the keyboard and trackpad stop working at all. Sometime they connect for a brief moment after a few minutes but then disconnect immediately.

I’m not using any Airport or Brcm kexts as this is an Apple card and in the odd occasions where the bluetooth ends up working after log in, it stays connected without any issues until I reboot. I also have proper USB maps in place where I’ve marked the Airport card as internal.

Anyone have any pointers on what the issue might be?