**UPDATE**
I don't know if it has fixed my issue as i haven't had time to fully test it as it happens randomly when i'm gaming/streaming but I decide "hey, what the hell i may aswell DDU my Driver and reinstall them" to what i didn't realise the first time i did this (I fully DDU'd my old 1060 6GB before i replaced it with the 5600XT) but DDU was still saying that the NVidia 1060 6Gb was there and my AMD RX 5600XT was also there, so Whilst in safe mode i removed the Nvidia ones with DDU (again) and then i booted into safe mode again and removed the AMD ones, then i reinstalled 20.4.2 (recommended driver) so hopefully this will solve my issue