Cloudflare routed 20 million AI requests through its own stack
Cloudflare has built its internal AI engineering stack using its own products, processing 241 billion tokens and routing 20 million requests through AI Gateway. This internal AI infrastructure serves over 3,683 users using Workers AI for inference. The company highlights the use of its own platform for its AI development.
Key Takeaways
- AI Gateway routed 20 million internal requests at Cloudflare.
- Cloudflare processed 241 billion tokens in its internal AI stack.
- Workers AI handled inference for more than 3,683 internal users.
- Cloudflare built the stack on the same products it ships to customers.
Why It Matters
Cloudflare is using its own AI products at meaningful internal scale, which gives it direct operational feedback from 20 million routed requests and 241 billion processed tokens. That ties product development to real usage across AI Gateway and Workers AI, rather than only customer deployments. For streaming and video teams watching infrastructure vendors, the signal is that Cloudflare is validating its AI stack inside the company before and while selling it outside. The next number to watch is whether those internal usage counts — especially 20 million requests and 3,683 users — continue to rise in future updates.
Read full article at blog.cloudflare.com
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source