WHAT IS AMD RYZEN™ AI?
AMD has a rich history of integrating its graphics technology onto CPUs for over a decade. With the recent surge in AI tools for creators, AMD has addressed these state-of-the-art workflows by providing dedicated compute devices to offload certain AI tasks. CPUs are designed for general purpose workflows while compute engines like the NPU are purpose built to efficiently accelerate AI inference. Many AI-accelerated tools available to content creators today can also be accelerated on the GPU. AMD Ryzen™ AI integrates all of these technologies (CPU, GPU, and NPU) into a single package, offering the flexibility to accelerate AI tasks on the compute device best suited for optimal results. This frees up the CPU and the end user to seamlessly continue working on non-AI-accelerated aspects of their workflow.
GENERATIVE AI INFERENCE - TODAY AND IN THE FUTURE
A hybrid approach to harnessing AI is critical and AMD believes PCs powered by AMD Ryzen™ AI will play a big role. For content creators, running AI applications locally on workstations presents many advantages. Firstly, it is designed to keep sensitive intellectual property and content within their control, which is aimed at reducing the risk of unauthorized access or data breaches. Local deployment may lead to cost savings by minimizing the need for cloud services and data transfer fees, allowing creators to allocate their resources more efficiently. Additionally, this approach can result in improved performance, enabling real-time processing and tailored experiences that enhance productivity and creativity. Therefore, for content creators, running AI applications locally on workstations offers a compelling solution to safeguard their work potentially reduce costs and enhance overall workflow efficiency.
LEADERSHIP PERFORMANCE
When comparing the integrated GPU performance of the AMD Ryzen PRO 9 7940HS CPU with Radeon™ 780M Graphics to an Intel© CoreTM i9-13900H with Intel© Iris© Xe Graphics, users can expect to see up to 3X better performance (2) in AI accelerated tools within DaVinci Resolve like slow motion, object masking and tracking and resolution upscaling.
For text to image generative AI tools like Stable Diffusion, the integrated GPU on the Ryzen PRO 9 7940HS processor offers up to 8X better performance than the competing Intel processor’s iGPU (3).
For AI assisted image classification, segmentation and detection tasks, the Ryzen PRO 7 7940HS processor delivers up to 2X better performance than the competing Intel processor’s iGPU (4)
AMD strategically invested in the past year to have efficient AI software architecture and optimizing the AI software stack for both APU and dGPU products working closely with our partners and the above performance is a reflection of that. Please refer to our blogs on detail about how we improved some of these AI assisted workloads:
- Stable Diffusion: [How-To] Automatic1111 Stable Diffusion WebUI with... - AMD Community
- DaVinci Resolve: AI Accelerated Video Editing with DaVinci Resolve ... - AMD Community
- Llama2: [How-To] Running Optimized Llama2 with Microsoft D... - AMD Community
“Our partnership with AMD allows us to support newer generation hardware, faster. Combined with the power of Ryzen AI, users of Topaz Labs software can run AI workloads locally, fast and efficiently, without having to depend on the cloud or share their data out. This delivers advantages in speed and efficiency while unlocking new potential for applications and experiences.” – Suraj Raghuraman, Head of AI Engine, Topaz Labs
By converging CPU, GPU, and NPU technologies into a cohesive unit, AMD Ryzen™ AI not only accelerates AI-driven tasks but also helps to ensure that content creators can work with greater efficiency on local workstations. This enables creators to push the boundaries of their creative potential while optimizing both time and cost.
Learn more at https://www.amd.com/en/products/processors/business-systems/ryzen-ai.html
Legal
- Ryzen™ AI is defined as the combination of a dedicated AI engine, AMD Radeon™ graphics engine, and Ryzen processor cores that enable AI capabilities. OEM and ISV enablement is required, and certain AI features may not yet be optimized for Ryzen AI processors. Ryzen AI is compatible with: (a) AMD Ryzen 7040 and 8040 Series processors except Ryzen 5 7540U, Ryzen 5 8540U, Ryzen 3 7440U, and Ryzen 3 8440U processors; and (b) all AMD Ryzen 8000G Series desktop processors except the Ryzen 5 8500G/GE and Ryzen 3 8300G/GE. Please check with your system manufacturer for feature availability prior to purchase. GD-220b.
- Testing as of 1/15/24 by AMD Internal Labs, utilizing a Dell Precision with Intel 13th Gen Intel© Core™ i9-13900H processor, Intel integrated graphics, 64GB RAM, 1TB SSD and Windows 11 Pro and a HP HP ZBook Power with AMD Ryzen 9 PRO 7940HS processor, Integrated Radeon 780M graphics, 64GB RAM, 1TB SSD, Windows 11 Pro, using the Davinci Resolve AI testbench to compare the integrated graphics performance on serveral AI accelerated tasks within Davinci Resolve. PC manufacturers may vary configurations yielding different results. Results may vary. PHXP-77
- Testing as of 1/15/24 by AMD Internal Labs, utilizing a Dell Precision with Intel 13th Gen Intel© Core™ i9-13900H processor, Intel integrated graphics, 64GB RAM, 1TB SSD and Windows 11 Pro and a HP HP ZBook Power with AMD Ryzen 9 PRO 7940HS processor, Integrated Radeon 780M graphics, 64GB RAM, 1TB SSD, Windows 11 Pro, using the AMuse benchmark to compare the integrated graphics performance on text to image AI inference. PC manufacturers may vary configurations yielding different results. Results may vary. PHXP-78
- Testing as of 1/15/24 by AMD Internal Labs, utilizing a Dell Precision with Intel 13th Gen Intel© Core™ i9-13900H processor, Intel integrated graphics, 64GB RAM, 1TB SSD and Windows 11 Pro and a HP HP ZBook Power with AMD Ryzen 9 PRO 7940HS processor, Integrated Radeon 780M graphics, 64GB RAM, 1TB SSD, Windows 11 Pro, using the Davinci Resolve AI testbench to compare the integrated graphics performance on serveral AI accelerated tasks within Davinci Resolve. PC manufacturers may vary configurations yielding different results. Results may vary. PHXP-79