Contributor

Apache Beam with Kenn Knowles and Pablo Estrada

Listen Later

Eric Anderson (@ericmander) reunites with old colleagues Kenn Knowles (@KennKnowles) and Pablo Estrada (@polecitoem) for a conversation on Apache Beam, the open-source programming model for data processing. The trio once worked together at Google, and Beam was a turning point in the history of open-source there. Today, both Kenn and Pablo are members of the Beam PMC, and join the show with the inside scoop on Beam’s past, present and future.

In this episode we discuss:

  • Transitioning Beam to the Apache Way
  • How “inner source” works at Google
  • Thoughts on the relationship between batch processing and streaming
  • Some ways that community “power users” have contributed to Beam
  • Information on Beam Summit 2022, the first onsite summit since COVID began
    • The first few people to register can use code BEAM_POD_INV for a discount on tickets!

      • Links:

      • Apache Beam
      • Apache Spark
      • Apache Flink
      • Apache Nemo
      • Apache Samza
      • Apache Crunch
      • MapReduce paper 
      • MillWheel paper
      • FlumeJava paper
      • Dataflow paper
      • Beam Summit 2022 Website

        • Other episodes:

        • TensorFlow with Rajat Monga
          • ...more
          View all episodesView all episodes
          Download on the App Store
          ContributorBy Eric Anderson
          • 5
          • 5
          • 5
          • 5
          • 5

          5

          11 ratings

          More shows like Contributor

          View all
          Planet Money by NPR

          Planet Money

          30,680 Listeners

          The Daily by The New York Times

          The Daily

          112,277 Listeners

          This Week in AI by JJ Englert

          This Week in AI

          4 Listeners