Update, after using the removal tool and deleting all previous drivers, again. I was able to get 19.12.3 to work on all of my games, but Rocket League. Rocket League still causes my graphics to crash on launch and require a restart on my PC. The rest of the games are seeing a nice improvement in fps.
So you may be good to go, though I hear there are still a lot of graphical glitches with the new CoD as well.