Did you remove the previous driver correctly, possibly with the cleaning tool?
For some games, it helps to downscale the render resolution in VR. If this is an option for you, give it a try.
And yes, unfortunately, NVidia seems to cut a slightly better figure here.
On the other hand, many drivers and cards ran very stable for me, so I still have hope that AMD will get to grips with this.