Skip to main content

Nvidia is renting out its AI Superpod platform for $90K a month

Nvidia is looking to make work and development in artificial intelligence more accessible, giving researchers an easy way to access its DGX supercomputer. The company announced that it will launch a subscription service for its DGX Superpod as an affordable way to gain entry into the world of supercomputers.

The DGX SuperPod is capable of 100 petaflops of AI performance, according to the company, and when configured 20 DGX A100 systems, it’s designed for large-scale AI projects.

Recommended Videos

Despite the company’s marketing take on the new subscription service, affordable is still relative, as Nvidia’s new Superpod subscription still costs $90,000 per month when it launches this summer.

Image used with permission by copyright holder

The Nvidia Base Command Platform will be powered by its DGX computers, and Nvidia is working with NetApp for storage. Nvidia also announced that it is working with Amazon Web Services and Google Cloud for instances within the cloud. The company claims that the hybrid experiences will allow developers to schedule jobs on-premise or in the cloud.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

By relying on the cloud and a subscription model, AI researchers now only need a smaller form factor that’s easier to fit into a server, and Nvidia is billing its new AI service as part of the company’s efforts to democratize artificial intelligence work. In the consumer space, Nvidia is also relying on the cloud to bring the power of its graphics technologies to consumers who may be unable to buy, run, or afford their own discrete GPU setup for gaming through its GeForce Now service.

For reference, Nvidia’s A.I.-powered DGX 2 supercomputer launched at a price of $399,000 and was known as the world’s largest GPU, while the newer, more powerful DGX A100 starts at $199,000 and is capable of 5 petaflops of AI performance.

The company claims this new subscription model allows you “to experience the best of Nvidia software and hardware that’s easy for you to use” without any contractual commitments. It’s designed as a way to test drive Nvidia’s solutions.

Nvidia’s subscription-based model will also include its Bluefield 2 data center processing unit, or DPU, with every DGX.

Image used with permission by copyright holder

“A new type of processor, designed to process data center infrastructure software, is needed to offload and accelerate the tremendous compute load of virtualization, networking, storage, security, and other cloud-native AI services,” Nvidia CEO Jensen Huang said of his company’s DPU earlier this year when the company unveiled its plans for Bluefield 3. “The time for BlueField DPU has come.”

Developers will have access to Nvidia’s AI Enterprise software, which is an open-source stack that the company has integrated into a coherent platform with a special focus on enterprise support. The AI Enterprise software also features deep integration with VMWare’s vSphere. Customers will also have access to Nvidia Omniverse Enterprise software.

A specific launch date was not announced, but the company said that all this will be coming this summer.

In data centers, Nvidia is looking to expand the ARM ecosystem beyond just mobile. Beginning next year, Nvidia announced that it will focus its work on bringing the ARM architecture to data centers. Given that a lot of AI work is already handled by the GPU, Nvidia claims that the role of the traditional CPU will become that of a data orchestrator rather than for heavy compute purposes.

The company hopes to leverage its acquisition of Arm to help transform the data center for AI workloads into an energy-efficient solution that’s just as powerful. Nvidia executives had previously hinted at its ambitions with the ARM architecture earlier this year when it announced its Grace processor.

Be sure to follow Digital Trends for all the latest news from Computex.

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
Zoom debuts its new customizable AI Companion 2.0
overhead shot of a person taking a zoom meeting at their desk

Zoom unveiled its AI Companion 2.0 during the company's Zoomtopia 2024 event on Wednesday. The AI assistant is incorporated throughout the Zoom Workplace app suite and is promised to "deliver an AI-first work platform for human connection."

While Zoom got its start as a videoconferencing app, the company has expanded its product ecosystem to become an "open collaboration platform" that includes a variety of communication, productivity, and business services, both online and in physical office spaces. The company's AI Companion, which debuted last September, is incorporated deeply throughout Zoom Workplace and, like Google's Gemini or Microsoft's Copilot, is designed to automate repetitive tasks like transcribing notes and summarizing reports that can take up as much as 62% of a person's workday.

Read more
From Open AI to hacked smart glasses, here are the 5 biggest AI headlines this week
Ray-Ban Meta smart glasses in Headline style are worn by a model.

We officially transitioned into Spooky Season this week and, between OpenAI's $6.6 million funding round, Nvidia's surprise LLM, and some privacy-invading Meta Smart Glasses, we saw a scary number of developments in the AI space. Here are five of the biggest announcements.
OpenAI secures $6.6 billion in latest funding round

Sam Altman's charmed existence continues apace with news this week that OpenAI has secured an additional $6.6 billion in investment as part of its most recent funding round. Existing investors like Microsoft and Khosla Ventures were joined by newcomers SoftBank and Nvidia. The AI company is now valued at a whopping $157 billion, making it one of the wealthiest private enterprises on Earth.

Read more
Apple says it made ‘AI for the rest of us’ — and it’s right
An Apple executive giving a presentation at WWDC 2024.

After many months of anxious waiting and salacious rumors, it’s finally happened: Apple has revealed its generative artificial intelligence (AI) systems to the world at its Worldwide Developers Conference (WWDC).

Yet unlike ChatGPT and Google Gemini, the freshly unveiled Apple Intelligence tools and features look like someone actually took the time to think about how AI can be used to better the world, not burn it down. If it works half as well as Apple promises it will, it could be the best AI system on the market.

Read more