Home
Tech Grid
News Room
Interviews
CISO POV
Think Stack
Articles
  • Agentic AI

CoreWeave Brings Up Multi-Rack NVIDIA Vera Rubin NVL72 Cluster


CoreWeave Brings Up Multi-Rack NVIDIA Vera Rubin NVL72 Cluster
  • by: Business Wire
  • |
  • September 18, 2026

CoreWeave, Inc., The Essential Cloud for AI, today announced the bring up of multi-rack NVIDIA Vera Rubin NVL72 on CoreWeave Cloud, putting hundreds of NVIDIA Rubin GPUs into a single scale-out cluster for agentic AI. The company also announced two new capabilities in CoreWeave AI Object Storage, cross-region write acceleration and a new Archive tier, that keep the data those workloads depend on close to the GPUs.

Multi-rack Vera Rubin NVL72 clusters allow for training and inference jobs to run across hundreds of Rubin GPUs. That matters for multi-step agentic workloads, which are sensitive to data-access latency because delays can compound across repeated model calls and tool use. Cross-region write acceleration removes the wait even when working across multiple regions.

Quick Intel

  • Cluster Bring Up: CoreWeave brings up multi-rack NVIDIA Vera Rubin NVL72 cluster on CoreWeave Cloud, unifying hundreds of Rubin GPUs into a single scale-out system for agentic AI training and inference.
  • Architecture Scale: Single Vera Rubin NVL72 rack pairs 72 Rubin GPUs with 36 Vera CPUs, NVLink 6, ConnectX-9 SuperNICs, and BlueField-4 DPUs, unified via NVIDIA Spectrum-X Ethernet networking.
  • Operational Automation: CoreWeave Mission Control automates rack lifecycle via Rack LifeCycle Controller, Racky for rack control, and Valvey for cooling, with full-rack workload validation before production.
  • Network Performance: Each Rubin GPU provides 1.6 Tb/s scale-out connectivity via dual ConnectX-9 SuperNICs across multiplane, multirail paths, supporting roughly 128,000 GPUs per rail in non-blocking fabric.
  • Storage Innovation: AI Object Storage LOTA delivers reads at local NVMe speeds, 8x lower latency vs traditional storage, up to 7 GB/s throughput per GPU, plus new cross-region write acceleration and Archive tier.
  • Industry Validation: First AI cloud provider to validate and bring up Vera Rubin NVL72, with record MLPerf results and top Platinum ranking in SemiAnalysis ClusterMAX 1.0 and 2.0.

What is Multi-Rack Vera Rubin NVL72 and Why It Matters for Agentic AI?

A single NVIDIA Vera Rubin NVL72 rack pairs 72 Rubin GPUs with 36 Vera CPUs, NVIDIA NVLink 6, NVIDIA ConnectX-9 SuperNICs, and NVIDIA BlueField-4 DPUs. With multi-rack Vera Rubin NVL72, CoreWeave unifies racks of hundreds of accelerators using NVIDIA Spectrum-X Ethernet networking into a single scale-out cluster.

This delivers the capacity to train larger models, serve more demanding inference workloads, and run reinforcement learning at scale, and achieves required engineering at every layer across compute, networking, storage, cooling, power, firmware, and software, to perform as one coordinated system. For multi-step agentic workloads sensitive to data-access latency, this scale ensures intermediate state, retrieved context, and outputs move as fast as reasoning without compounding delays.

Scaling Agentic AI with CoreWeave Mission Control and Spectrum-X

CoreWeave brings multiple racks up as a single system through automated lifecycle control and performance validation. Racks arrive as hardware that needs to be connected and validated. CoreWeave Mission Control automates rack setup through the Rack LifeCycle Controller, which coordinates hardware detection, firmware updates, validation, power, and cooling, with Racky providing rack control and Valvey executing cooling actions.

Validating performance from components to systems, CoreWeave combines NVIDIA field diagnostics with full-rack workload testing, comparing every result, building upon years of real-world experience, before a rack goes into production. Only racks that clear this bar as a system move into production, so every GPU performs at its best. Scaling the network with the GPUs, every Rubin GPU is equipped with two NVIDIA Connect X-9 SuperNICs per Rubin GPU, providing 1.6 Tb/s of connectivity scale out connectivity per GPU across multiplane, multirail paths, supporting roughly 128,000 GPUs per rail in a non-blocking fabric.

Keeping AI Data Close with AI Object Storage Upgrades

AI performance depends on keeping data moving as quickly as compute. CoreWeave AI Object Storage LOTA (Local Object Transport Accelerator) brings data closer to AI workloads through managed caching on each CoreWeave Kubernetes Service node, delivering reads at local NVMe speeds and reducing latency by 8x compared to reading from a traditional storage cluster.

New capabilities now allow customers to run workloads across two regions while avoiding cross-region write latency and reducing long-term storage costs. Checkpoints can now be written locally within a region, closest to the available compute. Data can now be written at local latency while being migrated to a second remote region in the background. Since the application sees a single bucket, there are no code changes, and permissions and retention rules work the same regardless of which region a write came from.

The Archive tier is a new lower-cost storage tier built for data teams routinely delete but would rather keep, such as checkpoints, reproduction datasets, and model versions, with no fee to retrieve it, no fee to delete it early, and no fee when reading it from the Archive tier.

CoreWeave consistently delivers industry-leading performance, demonstrated by record-breaking MLPerf benchmark results in inference and training, its position as the only AI cloud to earn the top Platinum ranking in both SemiAnalysis ClusterMAX 1.0 and 2.0, and its #1 ranking for inference speed and price-performance for Moonshot AI’s Kimi K2.6 and Kimi K2.7 Code in independent inference benchmarking conducted by Artificial Analysis.

“CoreWeave was the first AI cloud provider to validate and bring up a Vera Rubin NVL72, demonstrating that this advanced rack-scale architecture could operate as a reliable, high-performance cloud service,” said Chen Goldberg, executive vice president of product & engineering at CoreWeave. “With multi-rack Vera Rubin, we are connecting hundreds of Rubin GPUs as a single scale-out cluster. For customers building agentic AI, that means greater scale, faster iteration, and higher productivity as models and agents continuously learn and improve.”

“Our datasets span multiple regions, and we can’t afford to have our training schedule dictated by cross-region retrieval delays,” said Cécile Robert-Michon, director of internal infrastructure at Cohere. “CoreWeave AI Object Storage gives us a unified dataset footprint across regions with reads cached locally, so nothing waits on the network. It’s the difference between planning around our data and simply training.”

 

About CoreWeave

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to move at the pace of innovation, building and scaling AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave serves as a force multiplier by combining superior infrastructure performance with deep technical expertise to accelerate breakthroughs. Established in 2017, CoreWeave completed its public listing on Nasdaq (CRWV) in March 2025.

  • Agentic AIAI Object StorageAI Cloud
News Disclaimer
Want to reach B2B tech decision-makers through TechIntelPro? Get our Media Kit
  • Share
Enterprise Tech News