We are at a stage in our product ramp where we are consistently identifying new paths to unlock performance with our ROCM software and AMD Instinct MI300 accelerators. We have made a lot of progress since we recorded data in November that we used at our launch event and are delighted to share our latest results highlighting these gains.
These gains show that AMD Instinct MI300X with ROCm 6 continues to show leadership inference performance using the popular FP16 datatype and vLLM inference library compared to Nvidia H100 using TensorRT-LLM and FP16 or FP8 datatypes.
more