This can happen, check to see if it’s hotspot or if it’s the overall temp. My bet is it’s hotspot. Also check your VRAM usage at idle. There’s a bug on everything from 20.11.2 that keeps some cards VRAM maxed out at 1750 and causes heat issues even at idle. Last truly stable drivers for me was 20.11.1
Asus B450-I 2700x GSkill Trident Z 16GB 3200 CL16 XFX 5700 DD Ultra