5th Generation AMD EPYC processors are the latest addition to the powerful AMD EPYC family and the world’s leading CPU for AI. Visit AMD at SC24 to learn more and accelerate your path to AI leadership. 

In the financial services industry, enterprises that need to perform calculations for trading, market and credit risk, regulatory capital, limits, and initial margin can rely on the CompatibL Platform for their solution needs. As a leading Independent Software Vendor (ISV) in this space, CompatibL team lends their expertise to financial institutions and enables them to optimally execute their risk management applications, both on-prem and in the cloud. Part of that scoping effort from CompatibL includes the right sizing of hardware to ensure suitability for the specific needs of their customers. CompatibL evaluated CompatibL Platform on the latest AMD 4^th Gen EPYC-based instances available in the cloud, namely Amazon Web Services (AWS).

Choosing the right infrastructure when deploying AI for business use cases is key. As the complexity of AI workloads increases, enterprises need to make informed decisions about memory footprint and compute capabilities, especially when dealing with multimodal AI that requires multiple models working together.  I recently had the pleasure of talking with Steen Graham of Metrum Ai about solving real-world AI challenges and the future of enterprise AI for the AMD EPYC TechTalk podcast series, available here. You can also find highlights from the interview below.  

AMD has a comprehensive portfolio and approach to building efficient, secure, and future-ready data centers and is committed to open standards. AMD works across the entire server ecosystem to enable standards-based innovation. Our active involvement in Open Compute Project (OCP) and JDEC, along with new initiatives such as the Ultra Ethernet Consortium and Ultra Accelerator Link™ are just a few examples. These collaborations will help improve interoperability, simplify software development, and ensure long-term compatibility within the x86 ecosystem, making it easier for IT leaders to modernize their IT infrastructure in preparation for the age of AI.

• When AMD introduced the 1st generation of the AMD EPYC™ processor, we redefined what was possible. Previous, monolithic approaches to processor design were shuffled off the stage in favor of innovative approaches to meet the ever-increasing demands of modern datacenters.

Each successive generation of AMD EPYC processors has delivered both incremental and step-function levels of improvement in performance, scalability and energy efficiency. With the launch of the highly anticipated 5th generation based on AMD “Zen5” and “Zen5c” processor cores, I can confidently state that the AMD legacy of innovation and leadership is secure.

I'm thrilled to talk about an important addition to the AMD EPYC server processor family: 4th Gen AMD EPYC™ 4004 Series Processors. Large enterprises, demanding data centers, supercomputers, and hyperscalers have come to rely on the robust performance and scalability of AMD EPYC 7000, 8000, and 9000 Series Processors. By contrast, AMD EPYC 4004 Series Processors targets dedicated hosting providers and small businesses seeking cost-effective solutions for entry-level server workloads. These processors feature low core counts, Thermal Design Power (TDP) as low as 65 watts, and competitive pricing while maintaining the performance, scalability, and reliability expected from the AMD EPYC product line. This blog delves into some of the workloads for this market segment and the performance benefits offered by AMD EPYC 4004 processors.

AMD's new power management tools for EPYC 9004 and 8004 series CPUs offer IT directors more granular control over data center performance and power efficiency allowing users:

• Workload Optimization: The tools allow for fine-tuning of individual workloads to match their specific needs, ensuring optimal performance and energy consumption.
• Telemetry and Parameters: Telemetry agents gather real-time data, and pre-set parameters can be adjusted to control variables like heat, performance, power, and core idle states.
• Component Level Control: The EPYC architecture enables precise control of components like memory controllers, I/O subsystems, and CPU cores for peak efficiency.
• Customizable Power Settings: Features like configurable thermal design power (cTDP) and frequency boost allow for tailored power consumption settings.

AMD EPYC 4000 and AMD Alveo Ethernet adapters: An ideal combination for High Frequency Trading

Supermicro is one the world's premier producers of servers and storage systems, as well as a top provider of fast and efficient AI infrastructure. Linda Yang, a Supermicro senior solution manager, recently joined me on the AMD TechTalk podcast to discuss how the rapid evolution of AI models and workloads is driving change in AI infrastructure. I'm pleased to share highlights from the conversation in this blog post. You can listen to the full podcast here.

BeeKeeperAI operates a privacy-preserving, confidential computing platform that protects data and enables secure collaborations. At a time when security threats seem ubiquitous, BeeKeeperAI, with the help of security technologies built into AMD EPYC processors, help safeguard data. I had a great time speaking with Alan Czeszynski, BeeKeeperAI's marketing and product development leader. The full podcast can be accessed here.