Can't boot into clover from internal storage

I can't seem to boot into clover from internal storage however I can boot in from my USB just fine.

​

I have tried my multiple hard drives and SSD with different sized EFI partitions from 200MB to 650MB. I have both grub and Windows bootloader being detected from all my drives but not clover. I then tried to use efibootmgr to add my clover entry but it would not boot instead went to the second option which was grub. This was not an issues a year ago but I want to get it fixed as it's annoying have my USB plugged in all the time.

efibootmgr -c -d /dev/nvme0n1p1 -l /boot/efi/EFI/CLOVER/CLOVERX64.efi -L "Clover Boot Manager" 

​

Spec:

ASRock B250 Pro 4 motherboard i5 7500 RX 570 8GB