I understand that you are experiencing stutters in Destiny 2 when transitioning between map areas using Adrenalin 22.11.2 and newer drivers on your 6800XT graphics card. It appears that the shader cache is being regenerated every time you transition into a new zone, causing a drop in FPS until the shaders are fully cached. You have also tried the 23 series drivers but still experienced the same issue.
It is possible that this issue is related to the graphics driver, and rolling back to 22.11.1 WHQL seems to be the only stable driver for you. However, other users may have different experiences with different driver versions.
You may want to report this issue to AMD support or to the Destiny 2 community to see if others are also experiencing the same problem. They may be able to provide more specific guidance or solutions to help resolve this issue.