Netflix

42 개의 포스트

netflixtechblog.com

태그로 필터

netflix

In-House LLM Serving at Netflix (새 탭에서 열림)

In-House LLM Serving at Netflix -- 2 Listen Share By AI Platform’s Model Runtime team and Inference team Introduction Most organizations consume LLMs through hosted APIs. Netflix went further — we run the full stack ourselves, from model deployment through inference, inside our…