Oracle plans to deploy an enormous cloud supercomputer with a record number of connected GPUs.

The OCI Supercluster will support up to 131,072 Nvidia Blackwell GPUs, and will launch in the first half of 2025.

Oracle plane
– Sebastian Moss

That would give the system 2.4 zettaflops of peak performance, Oracle said, although it is referring to FP4 format, rather than FP64 or even FP8.

The maximum-specced version of the OCI Supercluster has more than three times as many GPUs as the Frontier supercomputer, the world's most powerful system, and more than six times that of other hyperscalers.

It is not clear if all 131,072 GPUs will be available at launch - DCD has contacted Oracle for clarification.

“We have one of the broadest AI infrastructure offerings and are supporting customers that are running some of the most demanding AI workloads in the cloud,” said Mahesh Thiagarajan, EVP of Oracle Cloud Infrastructure.

“With Oracle’s distributed cloud, customers have the flexibility to deploy cloud and AI services wherever they choose while preserving the highest levels of data and AI sovereignty.”

Smaller OCI Superclusters exist with Nvidia H100 GPUs, and others are coming with H200 and Blackwell GPUs. H100 Superclusters can scale up to 16,384 GPUs with up to 65 exaflops of performance and 13Pbps of aggregated network throughput.

H200 Superclusters, out later this year, will scale to 65,536 GPUs with up to 260 exaflops of performance and 52Pbps of aggregated network throughput.

OCI Superclusters with Nvidia's GB200 NVL72 liquid-cooled bare-metal instances will use NVLink and NVLink Switch to enable up to 72 Blackwell GPUs to communicate with each other at an aggregate bandwidth of 129.6 TBps in a single NVLink domain.

The location of the largest supercluster has not been shared.

Yesterday, Oracle founder Larry Ellison said that the company currently has 162 cloud data centers in operation or under construction globally, the largest of which has a capacity of 800MW.

A gigawatt facility is planned that will be powered by three small modular nuclear reactors.