Skip to main content

AMD is taking the gloves off in the AI arms race

AMD's CEO presenting the MI300X AI GPU.
AMD

AMD looks ready to fight. At its Advancing AI event, the company finally launched its Instinct MI300X AI GPU, which we first heard about first a few months ago. The exciting development is the performance AMD is claiming compared to the green AI elephant in the room: Nvidia.

Recommended Videos

Spec-for-spec, AMD claims the MI300X beats Nvidia’s H100 AI GPU in memory capacity and memory bandwidth, and it’s capable of 1.3 times the theoretical performance of H100 in FP8 and FP16 operations. AMD showed this off with two Large Language Models (LLMs) using a medium and large kernel. The MI300X showed between a 1.1x and 1.2x improvement compared to the H100.

AMD's CEO presenting the performance of MI300X AI GPU.
AMD

In a moment that looks ripped straight out of an Nvidia conference, AMD’s CEO Lisa Su introduced the MI300X Platform, which combines eight of the GPUs on a single board. AMD says these boards offer the same training performance as Nvidia’s H100 HGX and 1.6 times the inference performance. In addition, AMD says you’re able to run two LLMs per system, while H100 HGX can only handle one.

To illustrate how big of a deal this is, AMD brought out Microsoft’s Chief Technology Officer Kevin Scott to talk about how AMD and Microsoft are working together on AI. It’s important to highlight that the wildly popular ChatGPT is run on Microsoft servers, and it was originally trained on thousands of Nvidia GPUs.

A comparison between AMD's MI300X and Nvidia's H100.
AMD

In addition to the MI300X, AMD announced the MI300A, which is the first APU for AI, according to AMD. This combines AMD’s CDNA 3 AI GPU architecture with 24 Zen 4 CPU cores, along with 128GB of HBM3 memory. AMD says this is a balance between AI performance and high-performance computing, offering the CPU prowess that we recently saw on Threadripper 7000 to data centers.

Despite jumping on the AI bandwagon with the rest of the tech world, AMD has taken a deep backseat to Nvidia up to this point. Nvidia started investing big in AI years ago, giving it a massive head start over AMD and Intel. That early investment has catapulted Nvidia into becoming a trillion-dollar company this year.

With a GPU cluster that’s positioned to challenge Nvidia’s H100, as well as partnerships with Meta and Microsoft, AMD is finally entering the ring. AMD may exit bruised and bloodied, but it still looks like AMD is ready to put up a fight.

Jacob Roach
Former Digital Trends Contributor
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
Even AMD is surprised by how fast it’s gaining on Nvidia
Several AMD RX 9000 series graphics cards.

AMD's RX 9000 series quickly joined the ranks of the best graphics cards, and it appears that its success came as a surprise to everyone -- yes, even AMD itself. At a recent roundtable in Japan, the company revealed that its market share skyrocketed recently, reaching a whopping 45% in Japan. Although this refers to Japan, it's easy to imagine that AMD is gaining on Nvidia globally, too, although there are a few things to consider here.

AMD's Yoshiaki Sato and Saki Suzuki shared a couple of updates during a Team AMD Roundtable held in Japan, which was later shared by ASCII. AMD was joined on stage by representatives of its many board partners, including ASRock, Asus, Gigabyte, MSI, PowerColor, and Sapphire. AMD's add-in board partners (AIBs) reportedly shared that they wanted to make and sell more Radeon graphics cards, but were being held back due to a lack of GPUs. To this, AMD's Sato replied: "AMD isn't used to selling [this many] graphics cards."

Read more
AI PCs encouraging businesses to upgrade faster, targeting personalized employee experiences
AMD's CEO delivering the Computex 2024 presentation.

In 2025, AI is starting to feel like a buzzword to the general public -- but for a business, it's a day-to-day reality and the path toward accelerated growth. According to an IDC white paper that was sponsored by AMD, AI PCs are driving a major PC upgrade cycle. They're pushing businesses toward switching to PCs that integrate neural processing units (NPUs) to run AI tasks locally.

The white paper is based on a survey which targeted IT decision makers (ITDMs). Taking place in November 2024, the survey comprised 670 respondents from large companies (500 employees and up) located all around the world. Many were from large corporations -- 195 respondents were managers (or higher) in organizations with over 5,000 employees. There's also a broad range of industries here, including design and manufacturing, finance, and telecommunications.

Read more
AMD takes lead over Nvidia, but how long will it last?
An Asus RX 9070 XT TUF GPU.

While both AMD and Nvidia make some of the best graphics cards, pitting the two against each other usually reveals that Nvidia dominates the GPU market with an over 80% share. However, a new survey revealed that, at least in the recent weeks, many gamers preferred to go with AMD when buying a GPU. But how long will this surprising lead even last?

https://x.com/3DCenter_org/status/1899732939686256846

Read more