NVIDIA today announced that NVIDIA Groq 3 LPX, the interactive AI inference accelerator, is now in full production. An extension of the NVIDIA Vera Rubin platform, Groq 3 LPX delivers a major boost in AI inference by enabling ultrafast token generation for highly responsive agentic systems. Nebius is the first AI cloud to adopt NVIDIA Groq 3 LPX, with purpose-built AI inference cloud Groq planning to be among the platform's earliest adopters.
NVIDIA Groq 3 LPX now in full production as interactive AI inference accelerator
Delivered record 3,400 output tokens per second in Artificial Analysis benchmarking with Gemma 4 31B
Provides 4x faster responsiveness for agents than nearest alternative platform
Nebius is first AI cloud to adopt Groq 3 LPX via Nebius Token Factory
Groq 3 LPX extends Vera Rubin NVL72 by dramatically increasing token generation rates
Enables agentic tasks like coding in minutes versus hours with 100,000-token context support
Agentic systems can generate massive volumes of tokens across hundreds or thousands of inference steps, making faster token generation critical for agents to reason, act and complete complex tasks in real time. Vera Rubin NVL72 systems provide the most versatile training and inference platform for every AI factory. NVIDIA Groq 3 LPX extends the inference performance of Vera Rubin NVL72 by dramatically increasing the rate of token generation, providing premium user experiences for context-heavy workloads so agents can act at extreme speeds.
Agentic AI creates two distinct computing challenges: efficiently processing enormous amounts of context and generating tokens with extremely low latency. NVIDIA Groq 3 LPX is purpose-built to extend Vera Rubin's interactivity the rate at which tokens are generated for an individual user, determining how quickly an agent can complete each step of its work. Faster generation gives agents more time to inspect files, write and test code, call tools, verify results and iterate while maintaining a responsive user experience.
NVIDIA Groq 3 LPX is pushing the frontier of AI inference. It delivered a record 3,400 output tokens per second in Artificial Analysis benchmarking running Gemma 4 31B, an open source agentic model, with a 100,000-token context critical for agentic systems the fastest performance ever recorded for the model. Groq 3 LPX enables agentic tasks such as coding in minutes versus hours, providing 4x faster responsiveness for agents and latency-sensitive workloads than the nearest alternative platform.
"Inference is the growth engine of AI. NVIDIA Grace Blackwell and NVL72 revolutionized large language model inference with an unprecedented leap in performance and efficiency," said Jensen Huang, founder and CEO of NVIDIA. "Vera Rubin extends that vision with workload-optimized AI factory configurations designed for the era of agentic AI, advancing the performance frontier with LPX for ultrafast token generation. This transforms how intelligence is produced, delivering another giant leap in AI throughput, efficiency and responsiveness, just as demand for AI computation is accelerating worldwide."
AI clouds are becoming the engines of the AI economy, giving enterprises and developers access to advanced infrastructure for training, reasoning and inference at scale. For providers serving latency-sensitive, high-volume inference workloads, NVIDIA Groq 3 LPX provides a path to deploy differentiated compute in proven rack-scale systems.
Nebius, a leading AI cloud, plans to bring NVIDIA Groq 3 LPX to Nebius Token Factory, its production inference platform, giving developers access to extreme token generation speed for highly responsive agentic AI applications.
"Generation is the phase of inference that determines how responsive an AI system actually is, and that's exactly what NVIDIA Groq 3 LPX is built to accelerate," said Danila Shtan, chief technology officer of Nebius. "As the first AI cloud bringing it to production via Nebius Token Factory, we're making sure every step of an agent's loop feels instant through the same API developers are already using, with no migration to a new stack."
Following Nebius, purpose-built AI inference cloud Groq plans to be among the platform's earliest adopters.
Through extreme codesign across seven chips and five purpose-built racks, NVIDIA Vera Rubin is the most extensive AI factory platform. NVIDIA Vera Rubin NVL72 and Groq 3 LPX tackle the various workload requirements of customer AI factories, including frontier model makers and open model service providers. These rack platforms feature NVIDIA BlueField-4 DPUs and work in combination with NVIDIA Vera CPU racks, NVIDIA Vera BlueField-4 STX storage and NVIDIA Spectrum-6 SPX Ethernet to optimize multi-agent systems for the highest throughput per watt and the lowest-latency inference.
About NVIDIA
NVIDIA is the world leader in AI and accelerated computing.
