Mine also 6600XT, but the fans is good.
I never use zero rpm because I feel the fans gonna broke because stop start stop start. It is better spinning all the time with average RPM.
Try uninstall all driver and any third party fan apps if you have it.
Install back, turn off zero RPM, and adjust the fan speed based on temperature. Well, adjust as you see fit. As long as not hit 80 celcius with fan noise you can accept then all is ok.
MSI B550 Pro-VDH - MSI 6600XT - Ryzen 5600G