I had this problem in one game, A Plague Tale: Requiem, I just used the key combination, "CTRL, L-SHIFT, WIN, B" and it restarted the driver and my memory clock went back to normal. I have not had this problem since that game released, however.
My GPU Memory Clock does gray out in HWinfo64, but I don't experience any performance issues when Alt-Tabbing. You could try drivers that previously worked properly or Updated drivers if you aren't already running them.
I would uninstall old drivers with DDU or AMD Cleanup Utility, and reinstall the latest drivers if you haven't already. If this doesn't resolve the performance issues, you could always try older drivers. Whatever you choose to do, it would help the driver team, to first use the bug report tool in Adrenalin, giving them as much information about your PC and what you are doing when you experience this bug as possible.
Ryzen 7 7700X, MSI MAG X670E Tomahawk Wifi, Corsair DOMINATOR® TITANIUM RGB 2x16GB DDR5 DRAM 6000MT/s CL30, Sapphire Pulse AMD Radeon RX 7900 XTX, Corsair HX Series™ HX1000, Corsair MP600 PRO NH 4TB