i'm having similar issues. i just get random frame drops, mostly when entering new areas on a map, but seemingly random as well.
i just got this 6800 and i even get some random stuttering in some other games, all of them being dx11. namingly borderlands 3, gta 5 and warframe. destiny 2 is by far the worst though.
3d mark (dx12) runs absolutely fine.
i have not found a single driver that worked flawlessly. i've tried the following drivers:
22.5.1, 22.5.2, 22.9.2, 22.9.1 and 22.Q2 and 22.Q3 drivers.
out of all these 22.9.1 seems to be the least broken one.
not sure if its worth trying even older drivers?
i had a 3070 before and i literally had 0 issues with any games and im not really sure if i can assume AMD will fix this and if i should keep the card.