The Data Stack Show

The Data Stack Show

Download on the App Store

All The Data Stack Show episodes

  • 138: Paradigm Shift: Batch to Data Streaming with A.J. Hunyady of InfinyOn

    Highlights from this week’s conversation include:

    • A.J.’s background and journey in data (2:23)
    • Challenges with Hadoop ecosystem (8:50)
    • Starting InfinyOn and the need for innovation (10:02)
    • Challenges with Kafka and Microservices (14:01)
    • Real-time data streaming for IoT devices (19:28)
    • Paradigm shift to real-time data processing (22:17)
    • Benefits of Rust (29:45)
    • Web Assembly and Platform Features (36:29)
    • Analytics and Event Correlation (40:16)
    • Real-time data processing (47:03)
    • ETL vs ELP (52:20)
    • Final thoughts and takeaways (57:07)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    1 hr 3 min
  • 137: Data Collection Secrets & The Search Data Problem with Josh Wills

    Highlights from this week’s conversation include:

    • Josh’s background in data working at Google, Slack, and other companies (1:21)
    • The need and process for high quality data (4:33)
    • Digging into auction code (14:03)
    • Joining Slack and working in the early days of the company (18:00)
    • Not fighting the last war in data (25:42)
    • Building a product, while using the product (30:35)
    • Transitioning to the search team at Slack (36:50)
    • Usage patterns of search (41:21)
    • Josh’s work in helping build DuckDB (46:20)
    • Having the right toolset to increase precision and efficiency (52:42)
    • Final thoughts and takeaways (56:03)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    59 min
  • The PRQL: Data Engineers in the Front End with Josh Wills
    In this bonus episode, Eric previews his upcoming conversation with Josh Wills, an experienced data scientist who has worked with IBM, Google, Slack, DuckDB, and more. Hosted by Simplecast, an AdsWizz company. See https://pcm.adswizz.com
    for information about our collection and use of personal data for
    advertising.
    3 min
  • 136: System Evolution from Hadoop to RocksDB with Dhruba Borthakur of Rockset

    Highlights from this week’s conversation include:

    • Dhruba’s journey into the data space (2:02)
    • The impact of Hadoop on the industry (3:37)
    • Dhruba’s work in the early days of the Facebook team (7:54)
    • Building and implementing RocksDB (14:33)
    • Stories with Mark Zuckerberg at Facebook (24:25)
    • The next evolution in storage hardware (26:14)
    • How Rockset is different from other real-time platforms (33:13)
    • Going from a key value store to an index (37:15)
    • Where does Rockset go from here? (44:59)
    • The success of RocksDB as an open source project (49:11)
    • How do we properly steward real-time technology for impact (51:17)
    • Final thoughts and takeaways (56:18)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    1 hr 1 min
  • Data Council Week (Ep 7) - What’s Next for Data Council? With Pete Soderling of Data Council

    Highlights from this week’s conversation include:

    • The origin story of Data Council (0:39)
    • Developments for the future of Data Council (2:42)
    • The emphasis of AI and ChatGPT at this year’s conference (3:54)
    • The support of the data community (5:31)
    • Biggest changes and innovations in the industry (7:10)
    • What’s next for the Data Council? (10:46)
    • Getting connected with Data Council (13:07)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    16 min
  • Data Council Week (Ep 6) - All About Debezium and Change Data Capture With Gunnar Morling of Decodable

    Highlights from this week’s conversation include:

    • Gunner’s background in data (0:32)
    • Setting the vision in early days of Red Hat and spearheading Debezium (6:20)
    • Replication of data in Debezium (9:47)
    • The patterns and processes of Debezium (16:21)
    • Debezium working with Kafka (19:03)
    • Building a diverse system while incorporating common interfaces (24:09)
    • The importance of documentation in open-sourced projects (27:59)
    • Debezium’s vision moving forward (31:32)
    • Why aren’t there more CDC open-sourced solutions? (34:35)
    • Connecting with Gunnar (37:27)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    40 min
  • Data Council Week (Ep 5) - The Difference Between Data Platforms and ML Platforms with Michael Del Balso of Tecton

    Highlights from this week’s conversation include:

    • Michael’s journey to co-founding Tecton (0:22)
    • The evolution of MLops and platform teams (3:50)
    • Understanding boundaries between the data platform and the MLops (8:42)
    • Differences in machine learning vs data pipelines (16:58)
    • The systems needed to handle all these types of data (22:22)
    • Developer experience in Tecton (25:15)
    • Automating challenges in ML development (32:30)
    • The most difficult part of the life cycle of prediction (37:24)
    • Exciting new developments at Tecton (39:27)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    43 min
  • Data Council Week (Ep 4) - Using Data Anonymization for Identity Protection With Will Thompson of Privacy Dynamics

    Highlights from this week’s conversation include:

    • Will’s background in data (0:28)
    • Privacy dynamics and data anonymization (4:18)
    • Addressing data privacy problems in the space (10:33)
    • Developer experience with Privacy Dynamics (13:49)
    • How does Privacy Dynamics work? (21:09)
    • Update of real-time anonymized data (26:29)
    • The problem of dates and other complexities in data (31:24)
    • Being a data engineer in a startup (34:44)
    • Moving at the speed of a startup (41:01)
    • Connecting with Will and Privacy Dynamics (43:28)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    47 min