cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

AI Discussions

yaoshi1206
Journeyman III
Tuesday

Is there any easy way to run local LLMs on Ryzen AI 370?

I downloaded LM Studio 0.3.9 with AMD RyzenAI on "https://lmstudio.ai/ryzenai", Howerver it only run on CPU or GPU,  the NPU had 0% Utilization rate. Is there any easy way to run local LLMs on Ryzen AI 370?

Labels
1 Reply
myriad97
Journeyman III
Wednesday

Hi @yaoshi1206 , currently AMD XDNA (50 TOPS NPU) features are not yet supported by lmstudio.

unless somebody from the lmstudio explicitly mentioned XDNA NPU support.

for the time being, only GPU offload is your option.

0 Likes