Enterprises eye specialized GPU clouds as AI infrastructure costs remain opaque
A VentureBeat Pulse Research study of 107 enterprise decision-makers indicates that AI infrastructure investment is outpacing internal cost visibility, with 56% of organizations lacking rigorous tracking for compute economics. While hyperscalers remain the dominant providers, 64% of enterprises intend to switch or add new infrastructure providers within the next year, with specialized GPU clouds named as the primary target for evaluation.
Key Takeaways
- 45% of enterprises plan to evaluate AI-specialized clouds like CoreWeave and Lambda over the next 12 months.
- Only 21% of surveyed organizations currently run AI in production at scale, despite aggressive spending intentions.
- Integration with existing stacks (41%) and total cost of ownership (35%) are the primary drivers for vendor selection.
- 32% of respondents intend to evaluate non-NVIDIA accelerators, including AWS Trainium and Google TPUs.
- Less than 50% of enterprises rigorously track the cost and return on their current AI compute infrastructure.
Why It Matters
The immediate move toward specialized 'neoclouds' signals a potential re-platforming as enterprises look beyond traditional hyperscalers for performance. For the streaming and video infrastructure ecosystem, this shift prioritizes specialized GPU density over general-purpose cloud flexibility, though poor utilization rates suggest significant waste in current deployments. The disconnect between investment and cost visibility indicates that operational maturity lags behind capital allocation. Watch for whether the upcoming NVIDIA Blackwell (GB300) cycle, targeted by 28% of enterprises for evaluation, forces more rigorous unit economic tracking or further accelerates unmanaged spending.
Additional Context
The rise of specialized 'neoclouds' is fundamentally altering the competitive landscape of AI infrastructure. Per Synergy Research Group, July 2026, neocloud revenues reached $9 billion in Q4 2025, representing a 223% year-over-year increase. This growth is driven by structural constraints in traditional hyperscale supply, as firms like CoreWeave and Lambda Labs aggressively build out GPU-centric facilities. CoreWeave alone reported surpassing $5 billion in annual revenue in 2025, securing its position as the largest independent AI cloud provider through significant capital rounds involving NVIDIA and Coatue Management. Simultaneously, enterprise AI spending is shifting from experimental training to large-scale inference. Per Menlo Ventures, June 2026, enterprise generative AI spending ballooned from $11.5 billion in 2024 to $37 billion in 2025. However, matching this spend with ROI remains difficult; Stanford HAI's 2025 AI Index noted a 280x decline in the cost of fixed AI performance over two years, yet total enterprise bills continue to rise as consumption volume exceeds price drops. This paradox fuels the 'compute gap' as finance teams struggle to forecast usage-driven costs that often spike 50% or more monthly for heavy users. Infrastructure providers are now competing on integrated efficiency rather than raw token price. Per Reuters and NVIDIA reports, June 2026, the new NVIDIA Blackwell architecture is being marketed specifically for its power-efficient inference, claiming to run 20x more agents per megawatt than previous generations. This focus on performance-per-watt aligns with the reported enterprise shift toward total cost of ownership (TCO) as the decisive factor in procurement. As hyperscalers like Microsoft and AWS integrate Blackwell and Rubin architectures into their portfolios, the battle for enterprise loyalty will likely hinge on which platform provides the best tools for optimizing utilization and cost attribution.
Read full article at venturebeat.com
Get this in your inbox → Subscribe
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source