AI Discussions

[Ishigami]

<p>Hello, I have an AMD laptop with the following specs: <strong>AMD Ryzen 7 PRO 8840U w/ Radeon 780M Graphics 3.30 GHz</strong>.</p>
<p>I want to run LLMs, image generation models (like Stable Diffusion), vision models (image-to-text), and audio models locally using the system's <strong>NPU</strong> and <strong>integrated GPU</strong>. While exploring the AMD website, I came across <strong>Ryzen AI software</strong> and reviewed its capabilities. Based on my understanding, it appears that only a limited number of LLMs are currently supported on the NPU and GPU. I would like to confirm whether <strong>image generation and audio generation models</strong> are also supported on the NPU and GPU. Could you clarify this?</p>

[Uday_Das]

Yes, currently you can run generation model like Stable Diffusion on integrated GPU. 

[Ishigami]

Hi @Uday_Das  thanks for your response! Could you please provide a link to the steps for running the Stable Diffusion model on an AMD integrated GPU? I’d really appreciate it. Thank you!

[Ishigami]

Hi @Carteraiden907  I looked into the Ryzen AI software, which is designed for running generative AI models on the iGPU and NPU. However, I noticed limitations regarding support for other data modalities, and it is still under development. For image generation, they provided Stable Diffusion, but when I followed the steps mentioned in the blog, I encountered an error—Torch was unable to detect the GPU. Additionally, the blog referenced labels such as Adaptive AI (Versal, Zynq, Kria), AI Announcements, AI Software, Alveo AI, and EPYC AI, but did not mention Ryzen AI. This led me to the forums to confirm whether Stable Diffusion is optimized to run on an iGPU or requires a dedicated GPU.

Link Of Ryzen AI : https://ryzenai.docs.amd.com/en/latest/gpu/ryzenai_gpu.html 

Link Of the Blog : https://community.amd.com/t5/ai/how-to-automatic1111-stable-diffusion-webui-with-directml/ba-p/64902...