OpenAI unveils Jalapeño inference chip to slash gigawatt-scale AI costs

The introduction of Jalapeño signals a shift from broad GPU dependency to specialized silicon optimized for late-stage inference. By controlling the hardware layer, OpenAI can lower the marginal cost per query—a critical metric as interactive AI agents scale toward billions of weekly active users. For the streaming and video ecosystem, this movement toward custom ASICs suggests a roadmap for hyper-efficient, real-time video generation and processing that general-purpose hardware cannot yet provide at a sustainable price point. Watch for the first production-scale deployment in Microsoft data centers by Q4 2026 to validate these efficiency claims.

The Jalapeño project represents a significant milestone in OpenAI’s multibillion-dollar effort to secure its own physical infrastructure. As reported by Bloomberg in June 2026, OpenAI has committed tens of billions of dollars to Broadcom-designed chips to mitigate supply bottlenecks and dependence on Nvidia. Broadcom CEO Hock Tan confirmed that the collaboration includes high-performance networking and rack-level systems, which are expected to generate record AI semiconductor revenue for the chipmaker. Broadcom's quarterly AI-related revenue recently surged to $10.8 billion, a 143% year-over-year increase, largely driven by custom accelerators for hyperscalers like Google and Meta.

OpenAI’s move into silicon design has been led by Richard Ho, a former Google hardware veteran who helped orchestrate early TPU development. According to Reuters in February 2025, the internal team of roughly 40 engineers used OpenAI’s own models to shorten design cycles that typically take years. While the company still relies on Nvidia Blackwell GPUs for its most intensive model training, Jalapeño is intended to handle the lighter but more frequent inference tasks. This mirrors strategies at Amazon with Trainium and Google with its 7th-generation Ironwood TPUs, both of which seek to decouple application costs from the high premiums of third-party GPU vendors.

Manufacturing remains a primary constraint despite the successful design tape-out. Per Forbes in June 2026, every Jalapeño chip depends on Taiwan Semiconductor Manufacturing Company (TSMC) for advanced 3nm fabrication and CoWoS packaging. Because industry-wide packaging capacity is largely sold out through 2026, OpenAI’s ability to scale Jalapeño will depend on its allocation at TSMC alongside major players like Apple and Nvidia. To support this scale, OpenAI is also reportedly participating in the $500 billion Stargate infrastructure program, underscoring that custom silicon is only one piece of a broader, gigawatt-scale facility strategy.