cancel
Showing results for 
Search instead for 
Did you mean: 

AI Discussions

NotZeke
Journeyman III

AMD Radeon RX 7700s (mobile gpu) AI accelerator details and AI Tops

I'm not sure if anyone knows the details on this GPU, as on the spec sheet there is no mention of AI, but on the press release and the RX 7000 series page it does mention AI accelerators on all RDNA3 GPUs. So I was wondering how much AI Tops it has and more specs on the AI accelerators in it. Thank you!

 

Also on a side note, what is the difference between a NPU's AI Tops and AI Tops from a GPU. Like I see many GPUS with high AI Tops, way higher than those NPUs, why have an NPU when you can use a GPU with AI accelerators?

2 Replies
Uday_Das
Staff

NPU provides acceleration with lower power, and sometimes for latency critical model better latency. For short running Model GPUs are good, but for longer running models NPU provides better performance per watt. They can both be used in different usecases. 

 

Thanks 

0 Likes
GeorgeAnderson
Journeyman III

RX 7700S likely has limited AI TOPs; NPUs are optimized for efficiency, while GPUs offer raw AI power for broader tasks.

0 Likes