Accelerated computing has taken the industry by storm—bringing dramatic changes to how software applications including AI and HPC are developed and tuned for maximum impact. GPGPU solutions, such as those from AMD, have been pivotal in enabling advances in both AI and HPC. In the AI space, their massive parallel processing capabilities have been critical in powering the AI revolution, by supporting key frameworks like PyTorch, TensorFlow, and JAX. At the same time, their raw computing power delivers the performance necessary to optimize HPC applications like GROMACS for molecular dynamics simulation, OpenFOAM for computational fluid dynamics, NAMD for molecular modeling, and Ansys Mechanical for computer-aided engineering. By providing a robust, unified software stack catering to both AI and traditional HPC workloads, these accelerated computing platforms are driving breakthroughs across scientific and industrial computing. The versatility of GPGPU architectures makes them the preferred solution for designing, developing, and deploying AI and HPC at scale. This unmatched capability is underpinned by robust software ecosystems, which include libraries and tools widely used in AI and machine learning. This comprehensive support makes the development and deployment process easier and more efficient. 

We are at a stage in our product ramp where we are consistently identifying new paths to unlock performance with our ROCM software and AMD Instinct MI300 accelerators. We have made a lot of progress since we recorded data in November that we used at our launch event and are delighted to share our latest results highlighting these gains.

These gains show that AMD Instinct MI300X with ROCm 6 continues to show leadership inference performance using the popular FP16 datatype and vLLM inference library compared to Nvidia H100 using TensorRT-LLM and FP16 or FP8 datatypes.

Most Machine Learning (ML) engineers use single precision (FP32) datatype for developing ML models. TensorFloat32 (TF32) has recently become popular as a drop-in replacement for these FP32 based models. However, there is a pressing need to provide additional performance gains for these models by using faster datatypes (such as BFloat16 (BF16)) without requiring additional code changes.

Learn how AMD is working with Devito using high performance computing to help break down barriers to accurately model and predict the location of valuable resources in the oil and gas industry. 

AMD's open-source HIP API helps developers of GPU-accelerated applications like renderers and simulation tools write code that runs on AMD and NVIDIA hardware. Now the new HIP SDK makes it possible for anyone to use it.

This book aims to provide helpful guidance to GPU programmers looking to develop HIP programs for the ROCm platform using GPUs. The reader of this book will learn how to reason through real-world problems and break them down into independent parts so tha