Actually I misread your issue. I can step you though how to set a custom fan curve as well as turn on zero rpm mode if you like. It will require wattman profile xml files though.
Upload one with your custom fan curve and one where the zero rpm toggle is flipped.
This fix will keep fans off while not gaming.
