This is a general problem, not just you. Most people suffer from this problem, especially with rx580/rx570 cards. I am one of them, hoping that the company will fix this problem
You are not the only one who has this problem, unfortunately there is no solution sorry about it