If you are talking about trash can Mac Pro, you'll need to go for external GPU
It's doable, but some works need to be done
1. Apple doesn't officially support eGPU through TB2. However, there's a workaround
https://github.com/mayankk2308/purge-wrangler
2. At this moment only AMD/ATI cards are recommended since nVidia cards have been out of the game since 10.14. Unless you want to use some really dated but native supported Kepler cards.
From my personal experience any card after Polaris(Vega, Vega20) works perfectly.
Just keep in mind if you want to use one from XFX, you might need to flash other vendors' vBios so it will work.