It usually will say something like auto, off, advanced or manual to tweak the OC, I left the auto overclock on my B550 board and so far it's working well, and I didn't do any advanced overclocking either. It's something you should be able to look online to get the manual for your motherboard and it will describe the settings. If you set overclocking to off, it will have less stress on your PSU, so if that fixes the problems it would be good idea to replace the PSU. You can use a program like hardware info 64 and look and see if the 12V rail is going low below +/- 5%, 11.4 to 12.6 V range, when you run a benchmark or demanding game, that would point to your power supply not delivering enough power.
I think the power supply should be plenty and it's a good power supply, gold is higher efficiency, but it should work. Sometimes power supplies do go bad and can cause shutdowns. At this point I would try to find some other troubleshooting guides for Windows like making sure you don't have any corrupt windows files with sfc /scannow, look up some guides for troubleshooting when a PC reboots unexpectedly. These problems can be hard to track down. Good luck!
Edit- just to make sure, be certain you used the AMD Cleanup Utility or DDU program in safe mode to make sure the older drivers are fully removed, then installed the new drivers.
