I had the same issue. DDU worked fine for me as it does remove the entire Radeon package, verified with CCleaner for leftover registry entries. So what I found is the best stable release for the RX 5600 XT and most cards in the 5000 series is the 20.8.3 driver. Now all works fine. I recommend to always read the release notes prior to installing any new Radeon diver to see if there's a specific "fix" for an issue I'm having or a game support needed. If not, I leave the driver alone. I keep "auto update" off and decide whether or not to install a newer one. The "Factory Reset" is DDU, AMD bought the license for a custom version a while back.
"It worked before you broke it!"