Netflix Scheduling with Sharma Podila
Software Engineering Daily,
Originally posted on Software Engineering Daily
At Netflix, developers write applications with a variety of requirements–from simple requests for a list of movies to more resource-intensive requests like a complex machine learning workflow. Netflix wants developers to be able to request the resources they need from a compute cluster and receive those resources on-demand, without thinking too much about the state of that pool of resources they are drawing from.
At the cluster level, this means scheduling the application requests intelligently. Sharma Podila, a distributed systems software architect at Netflix, explains how Netflix has built a cloud native scheduling system on top of Mesos.
|The Insight Data Engineering Program helps software engineers level up their careers. Apply now at insightdataengineering.com/sedaily and skip straight to the coding challenge–a special offer for Software Engineering Daily listeners.|
|If you want to learn about Kubernetes, go to Apprenda.com/sedaily for a free webinar series about Kubernetes. Apprenda provides cloud platform software that works with your existing applications and infrastructure.|