Well, just like you, I'm having the exact same problem. I have an AMD RX 6800 XT, and after a lot of testing I've noticed that this problem is present in several games that run on DirectX 12. I've tried all sorts of settings in the AMD control panel and nothing has worked, however, I think it must be a bug in the current drivers.
This is a problem that is more noticeable when playing at 1080p. In my case, playing at 1440p doesn't bother me much, but it's true that AMD should fix it. I have friends with an RX 6650 XT and they have the same problem.
If you're really bothered by the reflections, I could suggest lowering their quality or disabling them altogether. As for the shadows, there is no way to fix it, it's something you'll have to get used to for now since AMD doesn't seem to be fixing it anytime soon.
If you have a 4K TV, I encourage you to try connecting your PC to that TV. Even though you'll be playing at 1080p on the TV, since it's a 4K TV, you won't notice the problem as much.
On the other hand, there are cases where enabling Virtual Super Resolution and selecting a resolution higher than the monitor's has helped to minimize the problem.
As I mentioned at the beginning, I think it's a problem with the new drivers, since some of my friends with an RX 6650 XT have told me that the problem has been fixed by reverting to driver 23.4.2, but unfortunately, that hasn't worked for my GPU.
I hope you can find a suitable configuration in the games and if you have any questions, don't hesitate to ask.