I know this is not 100% amd's fault.
How come I get mouse lag when running dual screen with the 18.8.2 drivers?
My RX580 is in the same situation.
Using only one screen will not lag.
I think its a known issue but you can send an email to AMD -> Email Form