Thunder Compute raises $13M to scale GPU virtualization for clouds
Thunder Compute has raised $13 million in Series A funding to scale its GPU virtualization software designed to improve hardware utilization rates in data centers. The technology aims to abstract GPU resources from specific workloads, allowing cloud providers and enterprises to optimize infrastructure efficiency for tasks like cloud encoding.
Key Takeaways
- Enterprise GPUs currently average utilization rates between 5% and 20% according to CastAI data.
- CEO Carl Peterson aims to build the 'VMware for GPUs' by treating chips as network resources rather than bare-metal allocations.
- Internal testing on Thunder Compute's own cloud service demonstrated workload efficiency gains of four times or more.
- The $13 million Series A will fund the transition from a self-operated cloud to enterprise and third-party provider deployments.
Why It Matters
The immediate implication is a potential shift in how streaming infrastructure is priced and provisioned, moving away from rigid bare-metal reservations toward fluid, utility-based compute. For the streaming ecosystem, this efficiency is critical as high-density workloads like cloud encoding and AI-driven personalization continue to strain data center budgets. By decoupling software from specific hardware, providers can theoretically lower the cost of entry for compute-heavy video services. Watch for the results of the company's two current enterprise pilots to see if the promised 4x utilization gains translate to significant reductions in public cloud egress and compute fees for high-volume streamers.
Additional Context
Thunder Compute enters a crowded field of GPU optimization startups competing for data center budgets. In January 2026, Cast AI raised funds from Pacific Alliance Ventures at a valuation surpassing $1 billion to launch a unified GPU marketplace called Omni Compute, which connects external GPU capacity as native compute and allows workloads to run across clouds without code changes. Oracle joined Omni Compute as the first major cloud provider to make excess GPU capacity available through the platform. Cast AI's approach differs from Thunder Compute's hardware-level virtualization by operating at the orchestration layer, but both target the same fundamental problem of underutilized compute resources in enterprise environments. The business case for GPU virtualization has gained urgency as AI workloads strain data center capacity and capital budgets. Cast AI's own 2025 Kubernetes Cost Benchmark Report found that only 10% of CPUs and 23% of memory are utilized across cloud environments, with complex manual capacity planning leaving most resources idle. That data point directly validates the $200 billion idle-capacity estimate cited in Thunder Compute's pitch. The company's April 2025 Series C, a $108 million round led by G2 Venture Partners and SoftBank Vision Fund 2, brought its customer base to 2,100 organizations including Akamai, BMW, FICO, Hugging Face, NielsenIQ, and Swisscom, demonstrating strong market demand for workload optimization tools across industries. Technical benchmarks from adjacent deployments suggest meaningful efficiency gains are achievable at scale. Cast AI's platform uses autonomous decision-making agents embedded in Kubernetes environments to continuously optimize performance and reliability, a model that the company describes as Application Performance Automation, turning performance signals into real-time automated actions across any cloud. For streaming operators running cloud encoding and AI-driven personalization pipelines, this shift means GPU capacity planning must account for increasingly unpredictable workload patterns. MistServer FrameWorks hybrid cloud solution enables flexible live video capacity, and Thunder Compute's abstraction layer, which pools GPU resources across network boundaries, addresses precisely this scheduling challenge by allowing providers to shift encoding jobs to available hardware without re-provisioning. The convergence of Cast AI's orchestration-layer approach and Thunder Compute's hardware-level virtualization suggests the market is bifurcating into complementary tiers rather than producing a single winner. provides further evidence of how automated resource management is becoming a standard requirement for modern video delivery stacks.
Read full article at siliconangle.com
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source