AWS Lambda provisioned mode now scales to 100,000 concurrent executions
AWS has launched a new 'provisioned mode' for its Lambda SQS and Apache Kafka event source mappings, allowing developers to manually configure poller counts. This update is designed to handle high-volume streaming and telemetry workloads by supporting up to 10 GB/s throughput and 100,000 concurrent Lambda executions.
Key Takeaways
- Provisioned mode supports up to 100,000 concurrent Lambda executions, a 16x increase over standard event source mapping limits.
- Developers can configure MinimumPollers (2–200) and MaximumPollers (up to 10,000) to ensure baseline capacity and burst readiness.
- The new mode achieves a scale-up rate of 1,000 concurrency units per minute, which is three times faster than default reactive scaling.
- Throughput capacity now reaches 10 GB/s, enabling the processing of up to one million events per second for telemetry or order pipelines.
- Availability extends to both Amazon SQS and Apache Kafka event source mappings, including Amazon MSK and self-managed Kafka clusters.
Why It Matters
AWS is addressing a critical bottleneck for high-concurrency streaming architectures: the lag between a traffic spike and the automated scaling of serverless polling infrastructure. By allowing teams to pay for pre-warmed 'Event Poller Units,' AWS enables real-time telemetry and ad-tech pipelines to maintain single-digit millisecond latency without manual sharding across multiple event source mappings. This shift moves Lambda closer to the sustained performance profiles of containerized architectures while retaining serverless orchestration. For the streaming ecosystem, this facilitates more reliable real-time engagement tracking and anti-fraud monitoring during high-traffic live events. Monitor CloudWatch EventCount metrics to optimize the balance between poller readiness and EPU-hour costs.
Additional Context
The expansion of AWS Lambda's polling limits comes as AWS reports record-breaking traffic across its serverless and messaging stack. Per Amazon reporting in August 2025, Amazon SQS reached a peak traffic record of 166 million messages per second during Prime Day 2025, while Lambda handled over 1.7 trillion daily invocations. The transition to provisioned mode for high-throughput workloads mirrors earlier 2024 updates, where AWS increased SQS FIFO in-flight message limits from 20,000 to 120,000 to accommodate larger concurrent consumer pools.
Competitive pressure in the serverless market is also driving these performance enhancements. According to data from SQ Magazine in June 2026, AWS currently holds 28% of the global cloud infrastructure market, facing increased competition from Microsoft Azure and Google Cloud, which hold 21% and 14% respectively. As AI-driven workloads accelerate—with Bedrock token volume in Q1 2026 surpassing all prior years combined—efficiently scaling the 'glue' between message queues and compute has become a primary differentiator for cloud providers supporting at-scale automation and real-time data processing.
Read full article at aws.amazon.com
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source