Try using DDU to remove the Nvidia drivers entirely, as well as the AMD drivers to start fresh. While I do see you said you are fairly certain you removed old drivers, the problem could easily be something saved from the old drivers conflicting with the new ones.
What driver version are you using? 22.11.2 WHQL is the recommended for that GPU, while 22.5.1 WHQL is what quite a few people here use because of stability issues. 22.5.1 WHQL used to be the recommended version.
If that doesn't work feel free to ask what to do next.
Ryzen 7 7800X3D, ASUS ROG STRIX X670E-F GAMING WIF, G.SKILL TRIDENT Z NEO 2x16GB DDR5 DRAM 6000MT/s CL30, AMD Radeon RX 7900 XTX, LIAN LI EDGE 1300, Corsair MP600 PRO NH 4TB