Juniper validates lossless RDMA over 500km for distributed AI clusters
Juniper Networks has published technical validation results demonstrating that its PTX10008 routers can maintain lossless RDMA over distances up to 500km. The testing utilized specific ECN marking thresholds and deep-buffer tuning to achieve 100% link utilization for distributed AI/ML training clusters.
Key Takeaways
- Validation achieved zero tail drops at 4:1 oversubscription using a buffer depth of 2.5 times the round-trip time.
- Testing utilized NVIDIA DGX Spark systems with ConnectX-7 NICs to maintain 67.1 MB of outstanding data per client.
- Optimal performance required disabling NIC slow restart and adaptive retransmission to prevent rate oscillations.
- Measured path latency for the 500km fiber loop reached 5,179 microseconds including optics and regeneration overhead.
Why It Matters
This validation proves that high-performance AI clusters can expand beyond the physical power and cooling constraints of a single data hall without sacrificing computational efficiency. By maintaining lossless transport over 500km, operators can link geographically dispersed facilities into a unified backend fabric, mitigating the 'go-back-N' retransmission stalls that typically plague RoCEv2 at distance. This capability reduces the need for expensive 1:1 DCI radix scaling, allowing strategists to leverage existing deep-buffer routing hardware for distributed training. Watch for future testing results involving Multipath Reliable Connection over SRv6 to further optimize multi-site GPU utilization.
Additional Context
Juniper Networks is positioning its PTX10008 platform as a bridge between traditional data center interconnect and the emerging requirements of distributed AI training. The validation of lossless RDMA over 500km arrives as operators and hyperscalers increasingly need to link geographically separated GPU clusters into unified fabrics. In June 2026, Ericsson launched its AI in RAN commercial software subscription claiming up to 20% higher downlink throughput across more than 15 live deployments, illustrating how network vendors across the stack are racing to prove AI-ready infrastructure at production scale. Juniper's approach differs by targeting the transport layer itself rather than application-level optimization, using deep-buffer architecture and ECN tuning to eliminate packet drops that would otherwise trigger costly retransmissions in RoCEv2 environments.
The business case for long-distance lossless transport is sharpening as AI workloads outgrow single-site power and cooling capacity. Nokia announced partnerships with AWS and Databricks at DTW Ignite to build a unified data and cloud control layer for autonomous networks, claiming operators are already achieving automation rates above 90% and service delivery times under four hours. While Nokia's focus is orchestration and OSS automation rather than physical transport, the convergence of agentic AI with network infrastructure signals that vendors across the ecosystem are competing to own the AI-era control plane. Juniper, now under HPE ownership following the acquisition completed in 2025, is betting that its routing silicon can serve as the deterministic foundation beneath those higher-layer AI services.
On the technical front, the competitive landscape for AI-optimized transport is intensifying. Ericsson described its network strategy as an intelligent fabric designed to host AI inference inside the network itself, with uplink traffic projected to triple over five years, driven by AI glasses, persistent voice interaction, and real-time video. That uplink growth trajectory underscores why lossless transport at distance matters beyond the data center: as inference moves closer to the edge, the interconnect fabric must handle bursty, latency-sensitive traffic without drops. , a split that mirrors the broader industry debate over where AI processing should sit relative to the network. Juniper's 500km validation adds a data point to that debate by demonstrating that the transport layer can remain lossless even as compute and inference distribute across wider geographies.
Read full article at community.juniper.net
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source