The Data Stack Show

The Data Stack Show

Download on the App Store

All The Data Stack Show episodes

  • Data Council Week: A Decade of Supporting the Data Community with Pete Soderling

    Highlights from this week’s conversation include:

    • Pete’s background and the origin story of Data Council (1:04)
    • Reflecting on 10 years of Data Council (2:07)
    • Impact of the pandemic on conferences (5:25)
    • Rebuilding after the pandemic (7:42)
    • Evolution of Data Council (10:33)
    • Balancing content and sponsorship (16:17)
    • Selecting speakers and content at Data Council (19:39)
    • Highlights from the conference this year (21:58)
    • Realization of AI Future (22:45)
    • Embracing AI at Data Council (23:31)
    • Announcement of Prime Ventures (25:43)
    • Improving Data Council (27:45)
    • Trends and Technologies (29:46)
    • Cautions for Startups (31:47)
    • Connecting with Data Council and Final Takeaways (33:09)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    37 min
  • Data Council Week: AI Isn’t Just Hype - How To Successfully Apply LLMs Today with Tristan Zajonc of Continual

    Highlights from this week’s conversation include:

    • Tristan's Background and Journey into Data (1:14)
    • Evolution of Machine Learning and AI (3:13)
    • Impact of Generative AI (6:33)
    • MLOps and Challenges in Early Data Science (8:48)
    • Success and Applications of AI Today (11:34)
    • Continual AI Copilot Platform (18:04)
    • Challenges in building remarkable AI assistants (19:58)
    • Reliability and accuracy in AI responses (25:31)
    • Regulation and adoption of AI assistants (31:30)
    • Future of AI assistants and Continual AI (33:12)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    36 min
  • Data Council Week: How To Do Self-Service Data Analytics and Business Intelligence Right with Ryan Dolley of GoodData

    Highlights from this week’s conversation include:

    • Ryan’s background in data (0:58)
    • Transition from Performing Arts to Data (2:23)
    • Understanding End Users in Data Projects (6:08)
    • Learning from Failures in Data Projects (8:07)
    • The self-service era (19:50)
    • Struggles of self-service (21:23)
    • The disillusion with dashboards (26:23)
    • GoodData's approach (30:06)
    • Merging wisdom with modern approach (31:50)
    • User experience with GoodData (34:05)
    • Defining metrics and AI (36:35)
    • Connecting with Ryan and GoodData (39:26)
    • Final thoughts and takeaways (41:06)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    43 min
  • 185: The Evolution of Data Processing, Data Formats, and Data Sharing with Ryan Blue of Tabular

    Highlights from this week’s conversation include:

    • The Evolution of Data Processing (2:36)
    • Ryan’s Background and Journey in Data (4:52)
    • Challenges in Transitioning to S3 (8:47)
    • Impact of Latency on Query Performance (11:43)
    • Challenges with Table Representation (15:26)
    • Designing a New Metadata Format (21:36)
    • Integration with Existing Tools and Open Source Project (24:07)
    • Initial Features of Iceberg (26:11)
    • Challenges of Manual Partitioning (31:49)
    • Designing the Iceberg Table Format (37:31)
    • Trade-offs in Writing Workloads (47:22)
    • Database Systems and File Systems (55:00)
    • Vendor Influence on Access Controls (1:01:58)
    • Restructuring Data Security (1:03:39)
    • Delegating Access Controls (1:07:22)
    • Column-level Access Controls (1:14:19)
    • Exciting Releases and Future Plans (1:17:47)
    • Centralization of Components in Data Infrastructure (1:25:37)
    • Fundamental Shift in Data Architecture (1:28:28)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    1 hr 30 min
  • The PRQL: The Two Parallel Tracks of Development In Data Processing with Ryan Blue of Tabular

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    5 min
  • 184: Kafka Streams and Operationalizing Event Driven Applications with Apurva Mehta of Responsive

    Highlights from this week’s conversation include:

    • Apruva’s background in streaming technology (0:48)
    • Developer experience and Kafka streams (2:47)
    • Motivation to bootstrap a startup (4:09)
    • Meeting the Confluent founders and early work at Confluent (6:59)
    • Projects at Confluent and transition to engineering management (10:34)
    • Overview of Responsive and event-driven applications (12:55)
    • Defining event-driven applications (15:33)
    • Importance of latency and state in event-driven applications (18:54)
    • Low Latency and Stateful Processing (21:52)
    • In-Memory Storage and Evolution of Kafka (25:02)
    • Motivation for KSQL and Kafka Streams (29:46)
    • Category Creation and Database-like Interface (34:33)
    • Developer Experience with Kafka and Kafka Streams (38:50)
    • Kafka Streams Functionality and Operational Challenges (41:44)
    • Metrics and Tuning Configurations (43:33)
    • Architecture and Decoupling in Kafka Streams (45:39)
    • State Storage and Transition from RocksDB (47:48)
    • Future of Event-Driven Architectures (56:30)
    • Final thoughts and takeaways (57:36)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    59 min
  • The PRQL: Event-Driven Applications: Where Low Latency Meets High Impact with Apurva Mehta of Responsive

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    4 min
  • 183: Why Modern Data Quality Must Move Beyond Traditional Data Management Practices with Chad Sanderson of Gable.ai

    Highlights from this week’s conversation include:

    • Chad’s background and journey in data (0:46)
    • Importance of Data Supply Chain (2:19)
    • Challenges with Modern Data Stack (3:28)
    • Comparing Data Supply Chain to Real-world Supply Chains (4:49)
    • Overview of Gable.ai (8:05)
    • Rethinking Data Catalogs (11:42)
    • New Ideas for Managing Data (15:16)
    • Data Discovery and Governance Challenges (18:51)
    • Static Code Analysis and AI Impact on Data (24:55)
    • Creating Contracts and Defining Data Lineage (27:31)
    • Data Quality Issues and Upstream Problems (32:32)
    • Challenges with Third-Party Vendors and External Data (34:29)
    • Incentivizing Engineers for Data Quality (40:28)
    • Feedback Loops and Actionability in Data Catalogs (45:30)
    • Missing metadata (48:57)
    • Role of AI in data semantics (50:27)
    • Data as a product (54:26)
    • Slowing down to go faster (57:38)
    • Quantifying the cost of data changes (1:01:24)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    1 hr 3 min
  • The PRQL: The Data Supply Chain with Chad Sanderson of Gable.ai

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    8 min
  • 182: Building a Dynamic Data Infrastructure at Enterprise Scale Featuring Kevin Liu of Stripe

    Highlights from this week’s conversation include:

    • Kevin’s background and work at Stripe (0:31)
    • Evolution of Data Infrastructure at Stripe (2:18)
    • Kevin's Interest in Data (5:29)
    • Software Engineer or Data Engineer? (8:27)
    • Speech Recognition Work at Amazon (11:06)
    • Efficiency and Cost Management (15:50)
    • Metadata and Query Analysis (18:38)
    • Surprising Discoveries in Metadata Analysis (21:43)
    • Optimizing Cost and Value (23:55)
    • Product Sizing Stripe Data (26:39)
    • Popular Tool for Data Interaction (30:08)
    • Enabling Data Infrastructure Integration (35:22)
    • Value of Data Pipelining for Stripe (39:32)
    • Next Generation Product and Technology (43:54)
    • Maximizing value in a decentralized environment (51:34)
    • Future of open source projects in data infrastructure (57:59)
    • Final thoughts and takeaways (59:02)

    The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.

    RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.


    Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

    1 hr 1 min