Feedback :
Upgraded the gpu drivers from 18.11.2 to 18.12.3 and the gpu fan on my Nitro RX 580 starts spinning at around 850 rpm at boot in windows 7 and never goes to zero (off). Fan mode was already set on automatic in the amd settings.
Reverted / Downgraded and fan behaviour is back to normal.