A Google Research paper presented at USENIX NSDI 2023 describes HALP, a heuristic-aided machine learning eviction policy for YouTube’s CDN DRAM cache aimed at improving cache efficiency with low CPU overhead. The authors report HALP has been running in YouTube CDN production since early 2022, reducing peak byte miss by an average of 9.1% with about 1.8% CPU overhead, and introduces an “impact distribution analysis” method to measure deployment impact under production noise.
Caching is one of streaming’s most leverage-heavy cost and QoE knobs: fewer byte misses means less origin egress, less backbone pressure, and more headroom during peaks. HALP is a reminder that “AI for systems” only ships when it’s operationally cheap, robust under workload drift, and measurable at scale. The real story isn’t just a 9% peak improvement—it’s the playbook: keep ML on a tight CPU budget, anchor it with heuristics, and prove impact with deployment-aware measurement. Expect this hybrid pattern to propagate across CDNs and streamer edge stacks.
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source