Try using DDU to remove the Nvidia drivers entirely, as well as the AMD drivers to start fresh. While I do see you said you are fairly certain you removed old drivers, the problem could easily be something saved from the old drivers conflicting with the new ones.
What driver version are you using? 22.11.2 WHQL is the recommended for that GPU, while 22.5.1 WHQL is what quite a few people here use because of stability issues. 22.5.1 WHQL used to be the recommended version.
If that doesn't work feel free to ask what to do next.
Ryzen 7 7700X, MSI MAG X670E Tomahawk Wifi, Corsair DOMINATOR® TITANIUM RGB 2x16GB DDR5 DRAM 6000MT/s CL30, Sapphire Pulse AMD Radeon RX 7900 XTX, Corsair HX Series™ HX1000, Corsair MP600 PRO NH 4TB