The Measure Pod

#87 A/B testing controversies and generative AI (with Shaun McGirr @ Dataiku)


Listen Later

Full show notes, transcript and (NEW!) AI chatbot - https://bit.ly/461QORs.

00:00:00 Intro.

00:00:32 Data expert discusses A-B testing and generative AI.
00:05:03 Different perspectives on data science.
00:09:34 Be holistic in data analysis.
00:14:16 Experimentation is both science and art.
00:18:02 Value of experimentation in CRO.
00:25:55 Data democratization is essential.
00:29:53 AI has the potential to revolutionize data analytics.
00:33:39 Data people should focus on efficiency.
00:36:18 Promote better question asking.
00:40:39 Data analysts need to adapt or risk being left behind.
00:44:56 Data perfection is a myth.

-----

Episode Summary:

In this week's episode of The Measure Pod, we dive into a fascinating conversation with Shaun McGirr, a data expert at Dataiku and former Crap Talks presenter. We explore the world of A/B testing, experimentation, and the future of analysts' roles as generative AI becomes more prevalent. Shaun shares his thoughts on the controversy surrounding A/B testing and the importance of considering other methods of learning about the world. We discuss the challenges and potential of using generative AI in the data analytics space, and how it can revolutionize the way we work with data. Grab your headphones and stap in for an insightful and thought-provoking discussion on the evolving landscape of data science and experimentation!

-----

Quotes of the Episode:

"We very commonly hear, oh, I can't do anything interesting with data or AI or predicting anything until I've got all my data perfect. It's a myth subscribed to by people who have never actually worked with data. Because if you have, you know it's never perfect and you still have to make a decision happen." - Shaun

"What if you provided an interface that helped people ask the right questions or at least better questions? And if they had no questions, they could be suggested questions and they could pick the questions that they liked the most, and then the job of data people to make LLMs useful is to do prompt engineering, right? To take the small human questions right? Put more context around them." - Shaun

"It still requires human curiosity." - Shaun

-----

About The Measure Pod:

The Measure Pod is a weekly podcast hosted by veteran practitioners of the marketing and product analytics industry. Join Dan and Dara from Measurelab, Bhav from CRAP Talks and the occasional guest on their quest to make sense of the analytics industry, and have some fun along the way.

-----

If you liked this episode, don't forget to subscribe to The Measure Pod on your favorite podcast platform and leave us a review. Let's make sense of the analytics industry together!

The post #87 A/B testing controversies and generative AI (with Shaun McGirr @ Dataiku) appeared first on Measurelab.

...more
View all episodesView all episodes
Download on the App Store

The Measure PodBy Measurelab


More shows like The Measure Pod

View all
The Analytics Power Hour by Michael Helbling, Moe Kiss, Tim Wilson, Val Kroll, and Julie Hoyer

The Analytics Power Hour

167 Listeners

Techmeme Ride Home by Brian McCullough

Techmeme Ride Home

941 Listeners

MarTech Podcast ™ // Marketing + Technology = Business Growth by I Hear Everything

MarTech Podcast ™ // Marketing + Technology = Business Growth

159 Listeners

Humans of Martech by Phil Gamache

Humans of Martech

5 Listeners

The Analytics Engineering Podcast by dbt Labs, Inc.

The Analytics Engineering Podcast

28 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,276 Listeners

Measure Up by Jim Gianoglio, Simon Poulton

Measure Up

4 Listeners

How I AI by Claire Vo

How I AI

4 Listeners