I believe I have the same issue as you but mine seems to be less frequent. I've tried every version of the 2020 drivers and got a black/blank screen crash on every one. When I use 19.12.1 nothing happens ever, 0 problems. I've also never crashed in a game when using 2020 drivers, it always seems to be sitting idle on the desktop or browsing the internet. Can you do me a favor and try to check in Windows event viewer for bugcheck errors. If you aren't sure how to use event viewer to find these just reply and I'll give you a more detailed explanation.
In my case when the crash happens I see error:
Attempt to reset the display driver and recover from timeout failed.
Are you saying you re-installed Windows and that's what fixed it for you?
yes, a full wipe of the SSD and reinstall windows 10 version 1909 and then updated it