In the financial services industry, enterprises that need to perform calculations for trading, market and credit risk, regulatory capital, limits, and initial margin can rely on the CompatibL Platform for their solution needs. As a leading Independent Software Vendor (ISV) in this space, CompatibL team lends their expertise to financial institutions and enables them to optimally execute their risk management applications, both on-prem and in the cloud. Part of that scoping effort from CompatibL includes the right sizing of hardware to ensure suitability for the specific needs of their customers. CompatibL evaluated CompatibL Platform on the latest AMD 4^th Gen EPYC-based instances available in the cloud, namely Amazon Web Services (AWS).

Choosing the right infrastructure when deploying AI for business use cases is key. As the complexity of AI workloads increases, enterprises need to make informed decisions about memory footprint and compute capabilities, especially when dealing with multimodal AI that requires multiple models working together.  I recently had the pleasure of talking with Steen Graham of Metrum Ai about solving real-world AI challenges and the future of enterprise AI for the AMD EPYC TechTalk podcast series, available here. You can also find highlights from the interview below.  

The momentum surrounding the 5th generation of AMD EPYC™ processors has exceeded all expectations. My previous blog explored enterprise and cloud workloads. Now, as promised, I’m excited to follow up and explore how these processors are transforming HPC and AI. Let’s take a closer look at how 5th Gen AMD EPYC processors accelerate performance in these critical areas.

I'm thrilled to talk about an important addition to the AMD EPYC server processor family: 4th Gen AMD EPYC™ 4004 Series Processors. Large enterprises, demanding data centers, supercomputers, and hyperscalers have come to rely on the robust performance and scalability of AMD EPYC 7000, 8000, and 9000 Series Processors. By contrast, AMD EPYC 4004 Series Processors targets dedicated hosting providers and small businesses seeking cost-effective solutions for entry-level server workloads. These processors feature low core counts, Thermal Design Power (TDP) as low as 65 watts, and competitive pricing while maintaining the performance, scalability, and reliability expected from the AMD EPYC product line. This blog delves into some of the workloads for this market segment and the performance benefits offered by AMD EPYC 4004 processors.

AMD EPYC 4000 and AMD Alveo Ethernet adapters: An ideal combination for High Frequency Trading

Supermicro is one the world's premier producers of servers and storage systems, as well as a top provider of fast and efficient AI infrastructure. Linda Yang, a Supermicro senior solution manager, recently joined me on the AMD TechTalk podcast to discuss how the rapid evolution of AI models and workloads is driving change in AI infrastructure. I'm pleased to share highlights from the conversation in this blog post. You can listen to the full podcast here.

BeeKeeperAI operates a privacy-preserving, confidential computing platform that protects data and enables secure collaborations. At a time when security threats seem ubiquitous, BeeKeeperAI, with the help of security technologies built into AMD EPYC processors, help safeguard data. I had a great time speaking with Alan Czeszynski, BeeKeeperAI's marketing and product development leader. The full podcast can be accessed here.     

A pile of money may lay hidden in supply chains across a range of global industries, says Bob Rogers, CEO and Co-Founder of Oii.ai. As a longtime security person, I really enjoyed speaking to Bob recently for the AMD EPYC TechTalk podcast series about Oii.ai's efforts to help clients uncover value in their supply chains via AI-powered automation. Bob's diverse background as a technologist, scientist and entrepreneur make him can't-miss listening. He earned a PhD in Physics from Harvard University, where he built simulations of black holes, a task not unlike what Oii.ai does today! Bob also participated in creating the world's first FDA-cleared AI on an X-ray device. You can listen to our discussion here, or read some of the highlights below.

AMD EPYC processors have been steadily improving over the past seven years, offering increased performance and energy efficiency with each new generation. The latest innovation, 3D V-Cache technology, has significantly boosted performance for demanding workloads.

How 3D V-Cache Works

• Increases L3 cache size: By stacking additional cache layers, 3D V-Cache triples the L3 cache compared to standard EPYC processors.
• Benefits demanding workloads: Particularly effective for design and simulation tasks like computational fluid dynamics (CFD), finite element analysis (FEA), and electronic design automation (EDA).

Real-World Impact

• STMicroelectronics: Achieved a 12% performance boost in EDA and CAD workloads using 3rd Gen EPYC with 3D V-Cache compared to other CPUs.
• Performance benchmarks: Showed substantial improvements in various EDA tools and CFD simulations with the latest 4th Gen EPYC processors featuring 3D V-Cache.

Overall, AMD EPYC processors with 3D V-Cache are a powerful solution for organizations handling technical computing workloads.

I always enjoy learning from people who understand how essential collaboration is to innovation. Alan Benjamin, CEO of GigaIO, is one of those people--and he was kind enough to spend some time speaking with us on our AMD TechTalk podcast. GigaIO, a company that provides workload-defined infrastructure for AI and technical computing, made news last year by configuring 32 AMD Instinct MI210 accelerators to a single-node server called the SuperNODE. Up to then, accessing 32 GPUs required four servers equipped with eight GPUs apiece — as well as all the cost and latency associated with linking up all of that extra hardware. I've included some of the interview highlights in the blog post below.