11 posts
State of Routing in Model Serving -- 3 Listen Share By Nipun Kumar, Rajat Shah, Peter Chng Introduction This is the first blog post in a multi-part series that shares technical insights into how our ML model serving infrastructure powers several personalized experiences at scale…
Scaling Camera File Processing at Netflix -- Listen Share Orchestrating Media Workflows Through Strategic Collaboration Authors: Eric Reinecke, Bhanu Srikanth Introduction to Content Hub’s Media Production Suite At Netflix, we want to provide filmmakers with the tools they need…
Evaluating Netflix Show Synopses with LLM-as-a-Judge -- Listen Share by Gabriela Alessio, Cameron Taylor, and Cameron R. Wolfe Introduction When members log into Netflix, one of the hardest choices is what to watch. The challenge isn’t a lack of options — there are thousands of…
Stop Answering the Same Question Twice: Interval-Aware Caching for Druid at Netflix Scale -- Listen Share By Ben Sykes In a previous post, we described how Netflix uses Apache Druid to ingest millions of events per second and query trillions of rows, providing the real-time insi…
Synchronizing the Senses: Powering Multimodal Intelligence for Video Search -- 2 Listen Share By Meenakshi Jindal and Munya Marazanye Today’s filmmakers capture more footage than ever to maximize their creative options, often generating hundreds, if not thousands, of hours of ra…
Scaling Global Storytelling: Modernizing Localization Analytics at Netflix -- Listen Share Valentin Geffrier, Tanguy Cornuau Each year, we bring the Analytics Engineering community together for an Analytics Summit — a multi-day internal conference to share analytical deliverable…
Optimizing Recommendation Systems with JDK’s Vector API -- 1 Listen Share By Harshad Sane Ranker is one of the largest and most complex services at Netflix. Among many things, it powers the personalized rows you see on the Netflix homepage, and runs at an enormous scale. When we…
Mount Mayhem at Netflix: Scaling Containers on Modern CPUs -- 6 Listen Share Authors: Harshad Sane, Andrew Halaney Imagine this — you click play on Netflix on a Friday night and behind the scenes hundreds of containers spring to action in a few seconds to answer your call. At Ne…
MediaFM: The Multimodal AI Foundation for Media Understanding at Netflix -- 7 Listen Share Avneesh Saluja, Santiago Castro, Bowei Yan, Ashish Rastogi Introduction Netflix’s core mission is to connect millions of members around the world with stories they’ll love. This requires n…
Scaling LLM Post-Training at Netflix -- 6 Listen Share Baolin Li, Lingyi Liu, Binh Tang, Shaojing Li Introduction Pre-training gives Large Language Models (LLMs) broad linguistic ability and general world knowledge, but post-training is the phase that actually aligns them to con…
Automating RDS Postgres to Aurora Postgres Migration -- Listen Share Ram Srivasta Kannan, Wale Akintayo, Jay Bharadwaj, John Crimmins, Shengwei Wang, Zhitao Zhu Introduction In 2024, the Online Data Stores team at Netflix conducted a comprehensive review of the relational databa…