I noticed recently that the amd radeon driver is always using a bit a cpu in idle while nothing is actually using the gpu (using the latest drivers). The issue only occurs with my Vega 64, I tried with my RX 470 and everything went back to normal (using the exact same setup and driver). I had to downgrade to 19.5.2 to see the bug disappear while using Vega 64.