This sounds like your GPU cooler is working the way it should. Everything is working well.
If the noise level is bothering you, then you can indeed try manual fan curve with max RPM limit,
but this will lead to higher GPU temps, less GPU performance and could also lead to crashes.
If you really want to try a custom Fan Curve with lower RPM, then please try this:
temp 50°C = 30% RPM
temp 60°C = 40% RPM
temp 70°C = 50% RPM
temp 80°C = 60% RPM
temp 90°C = 100% RPM
This custom fan curve will still cool your GPU enough,
while maintaining lower RPM as long as the temp stays low.
--- [ CPU: Ryzen 7 3800XT | GPU: ASRock RX 5700XT Challenger Pro 8GB | driver: 24.1.1 ]
--- [ MB: MSI B550-A Pro AGESA 1.2.0.7 | RAM: 2x 16GB 3600-CL16 | chipset: 6.01.25.342 ]