Cloud Engineering Archives - Software Engineering Daily

Netflix Genie with Tom Gianos

Listen Later

“Sometimes there’s a misconception that Genie is a job scheduling platform… Genie really represents our extraction layer, from what our computational resources are, to our end user jobs.”

Genie is an open-source tool that provides job and resource management for the Hadoop ecosystem in the cloud.

Tom Gianos is a Senior Software Engineer at Netflix focusing on its big data platform. He is one of the core contributors in charge of maintaining and improving Genie.

Questions
  • How fast is the pace of Netflix data collection increasing?
  • What are the differences between running Hadoop in the cloud and running it in a data center?
  • Why is job and resource management so important for a Hadoop ecosystem?
  • What does Netflix do with spare computational resources?
  • What is a bonus cluster?
  • Does Netflix collect more data than it can practically make use of?
    • Links
    • Genie
    • Yarn – Resource Scheduling Layer
    • Hadoop Platform as a Service in the Cloud
    • SE Daily Episode on Presto
    • Spring Boot

      • The post Netflix Genie with Tom Gianos appeared first on Software Engineering Daily.

      ...more
      View all episodesView all episodes
      Download on the App Store
      Cloud Engineering Archives - Software Engineering DailyBy Cloud Engineering Archives - Software Engineering Daily
      • 3.8
      • 3.8
      • 3.8
      • 3.8
      • 3.8

      3.8

      31 ratings

      More shows like Cloud Engineering Archives - Software Engineering Daily

      View all
      Software Engineering Radio by se-radio@computer.org

      Software Engineering Radio

      270 Listeners

      Software Engineering Daily by Software Engineering Daily

      Software Engineering Daily

      623 Listeners

      Soft Skills Engineering by Jamison Dance and Dave Smith

      Soft Skills Engineering

      289 Listeners

      Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

      Syntax - Tasty Web Development Treats

      987 Listeners

      Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

      Kubernetes Podcast from Google

      181 Listeners

      AWS Podcast by Amazon Web Services

      AWS Podcast

      205 Listeners

      Big Technology Podcast by Alex Kantrowitz

      Big Technology Podcast

      497 Listeners