Contributor

Apache Beam with Kenn Knowles and Pablo Estrada

Listen Later

Eric Anderson (@ericmander) reunites with old colleagues Kenn Knowles (@KennKnowles) and Pablo Estrada (@polecitoem) for a conversation on Apache Beam, the open-source programming model for data processing. The trio once worked together at Google, and Beam was a turning point in the history of open-source there. Today, both Kenn and Pablo are members of the Beam PMC, and join the show with the inside scoop on Beam’s past, present and future.

In this episode we discuss:

  • Transitioning Beam to the Apache Way
  • How “inner source” works at Google
  • Thoughts on the relationship between batch processing and streaming
  • Some ways that community “power users” have contributed to Beam
  • Information on Beam Summit 2022, the first onsite summit since COVID began
    • The first few people to register can use code BEAM_POD_INV for a discount on tickets!

      • Links:

      • Apache Beam
      • Apache Spark
      • Apache Flink
      • Apache Nemo
      • Apache Samza
      • Apache Crunch
      • MapReduce paper 
      • MillWheel paper
      • FlumeJava paper
      • Dataflow paper
      • Beam Summit 2022 Website

        • Other episodes:

        • TensorFlow with Rajat Monga
          • ...more
          View all episodesView all episodes
          Download on the App Store
          ContributorBy Eric Anderson
          • 5
          • 5
          • 5
          • 5
          • 5

          5

          11 ratings

          More shows like Contributor

          View all
          The Joe Rogan Experience by Joe Rogan

          The Joe Rogan Experience

          223,304 Listeners

          Pivot by New York Magazine

          Pivot

          8,534 Listeners

          Python Bytes by Michael Kennedy and Brian Okken

          Python Bytes

          214 Listeners

          The Daily by The New York Times

          The Daily

          112,857 Listeners

          Techmeme Ride Home by Ride Home Media

          Techmeme Ride Home

          948 Listeners

          Huberman Lab by Scicomm Media

          Huberman Lab

          28,212 Listeners

          On with Kara Swisher by Vox Media

          On with Kara Swisher

          3,111 Listeners