Artificial intelligence (AI) workloads have deservedly placed GPUs in the spotlight, but there’s a clutch player often overlooked: the host CPU. 

KEY TAKEAWAYS

• Your GPU needs a fast CPU—it’s the air traffic controller keeping AI inference running smoothly.
• High-frequency CPUs like AMD EPYC 9575F improve GPU efficiency by reducing latency in key AI tasks.
• Benchmarks show up to 10% faster inference times with AMD EPYC 9575F over Intel Xeon.
• Maximize AI ROI by choosing the right CPU for your GPUs!

Ask a typical IT professional today whether they're leveraging AI, and there's a good chance they'll say yes–after all, they have reputations to protect! Kidding aside, many will report that their teams may use Web-based tools like ChatGPT or even have internal chatbots that serve their employee base on their intranet, but for that not much AI is really being implemented at the infrastructure level.  

NexaQuants can recover reasoning capability loss for DeepSeek R1 Distills observed at Q4 quantization. 

AI PCs have evolved rapidly in the two years since AMD introduced the first x86 AI PC CPUs. In a new report, Forrester argues that 2025 will be an important year for AI PC adoption as system capabilities expand and software support improves. 

You can try out the DeepSeek R1 distilled models on your AMD Ryzen™ AI processor or Radeon™ graphics card in just a few short steps!

AMD, in collaboration with the ONNX Community and the Linux Foundation, has released an open-source tool to help developers explore and understand machine learning models. Digest is a powerful model analysis tool designed to help you extract valuable insights from your machine learning models. With Digest, you can easily organize, report on, and optimize your models, making your workflow more efficient and effective.  

AMD enhances Visual Language Models (VLMs) by optimizing the processing capabilities, making them faster and more accurate for variable applications. 

2024 was a transformative year for AMD Instinct™ accelerators. In the last 12 months we successfully delivered dozens of Instinct MI300X platforms to market across our cloud and OEM partners. We ramped numerous customers into volume production, including

AMD is excited to release one-step diffusion models that demonstrate the readiness of AMD Instinct™ MI250 accelerators for model training and further research. The models are designed to provide performance comparable to traditional full-step diffusion models while maintaining the efficiency needed for training on data center systems or deployment on edge devices, such as AI-enabled PCs and laptops.

 Full technical blog AMD Nitro Diffusion: One-Step Text-to-Image Generation Models

The AMD Alveo™ V80 compute accelerator brings massive hardware parallelism and memory bandwidth for workloads with large datasets. Visit us at SC24 to learn how this solution can help you accomplish more with HPC and AI.