Imagine a world where business users simply fire up their analytics AI tool, ask for some insights, and get a clear and accurate response in return. That’s the dream, isn’t it? Is it just around the corner, or is it years away? Or is that vision embarrassingly misguided at its core? The very real humans who responded to our listener survey wanted to know where and how AI would be fitting into the analyst’s toolkit, and, frankly, so do we! Maybe they (and you!) can fire up ol’ Claude and ask it to analyze this episode with Juliana Jackson from the Standard Deviation podcast and Beyond the Mean Substack to find out! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Did you know that, upon closer inspection, many a statistical test will reveal that "it's just a linear model" (#IJALM)? That wound up being a key point that our go-to statistician, Chelsea Parlett-Pelleriti, made early and often on this episode, which is the next installment in our informally recurring series of shows digging into specific statistical methods. The method for this episode? ANOVA! As a jumping off point to think about how data works—developing intuition about mean and variance (and covariates) while dipping our toes into F-statistics, family-wise error rates (FWER), and even a little Tukey HSD—ANOVA’s not too shabby!

For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Product managers for BI platforms have it easy. They "just" need to have the dev team build a tool that gives all types of users access to all of the data they should be allowed to see in a way that is quick, simple, and clear while preventing them from pulling data that can be misinterpreted. Of course, there are a lot of different types of users—from the C-level executive who wants ready access to high-level metrics all the way to the analyst or data scientist who wants to drop into a SQL flow state to everyone in between. And sometimes the tool needs to provide structured dashboards, while at other times it needs to be a mechanism for ad hoc analysis. Maybe the product manager’s job is actually…impossible? Past Looker CAO and current Omni CEO Colin Zima joined this episode for a lively discussion on the subject!

For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

It’s a process few people genuinely enjoy, but it’s one which we all find ourselves going through periodically in our careers: landing a new job. We grabbed MajorData himself, Albert Bellamy, for a wide-ranging discussion about the ins and outs of that process: LinkedIn invitation etiquette (and, more importantly, effectiveness), how networking is like spousal communication (!), the usefulness of reducing the mental load required of recruiters and hiring managers, and much, much more! You might just want to drop and do twenty push-ups by the end of the episode! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Synthetic data: it's a fascinating topic that sounds like science fiction but is rapidly becoming a practical tool in the data landscape. From machine learning applications to safeguarding privacy, synthetic data offers a compelling alternative to real-world datasets that might be incomplete or unwieldy. With the help of Winston Li, founder of Arima, a startup specializing in synthetic data and marketing mix modelling, we explore how this artificial data is generated, where its strengths truly lie, and the potential pitfalls to watch out for! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Is it just us, or are data products becoming all the rage? Is Google Trends a data product that could help us answer that question? What actually IS a data product? And does it even matter that we have a good definition? If any of these questions seem like they have cut and dried answers, then this episode may just convince you that you haven't thought about them hard enough! After all, what is more on-brand for a group of analysts than being thrown a question that seems simple only to dig in to realize that it is more complicated than it appears at first blush? On this episode, Eric Sandosham returned as a guest inspired by a Medium post he wrote a while back so we could all dive into the topic and see what we could figure out! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

No matter how simple a metric's name makes it sound, the details are often downright devilish. What is a website visit? What is revenue? What is a customer? Go one level deeper with a metric like customer acquisition cost (CAC) or customer lifetime value (CLV or LTV, depending on how you acronym), and things can get messy in a hurry. In some cases, there are multiple "right" definitions, depending on how the metric is being used. In some cases, there are incentive structures to thumb the definitional scale one way or another. In some cases, a hastily made choice becomes a well-established, yet misguided, norm. In some cases, public companies simply throw their hands up and stop reporting a key metric! Dan McCarthy, Associate Professor of Marketing at the Robert H. Smith School of Business at the University of Maryland, spends a lot of time and thought culling through public filings and disclosures therein trying to make sense of metric definitions, so he was a great guest to have to dig into the topic! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Data that tracks what users and customers do is behavioral data. But behavioral science is much more about why humans do things and what sorts of techniques can be employed to nudge them to do something specific. On this episode, behavioral scientist Dr. Lindsay Juarez from Irrational Labs joined us for a conversation on the topic. Nudge vs. sludge, getting uncomfortably specific about the behavior of interest, and even a prompting of our guest to recreate and explain a classic Seinfeld bit! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

We finally did it: devoted an entire episode to AI. And, of course, by devoting an episode entirely to AI, we mean we just had GPT-4o generate a script for the entire show, and we just each read our parts. It's pretty impressive how the result still sounds so natural and human and spontaneous. It picked up on Tim's tendency to get hot and bothered, on Moe's proclivity for dancing right up to the edge of oversharing specific work scenarios, on Michael's knack for bringing in personality tests, on Val's patience in getting the whole discussion to get back on track, and on Julie being a real (or artificial, as the case may be?) Gem. Even though it includes the word "proclivity," this show overview was entirely generated without the assistance of AI. And yet, it’s got a whopper of a hallucination: the episode wasn’t scripted at all! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

How is an outlier in the data like obscenity? A case could be made that they're both the sort of thing where we know it when we see it, but that can be awfully tricky to perfectly define and detect. Visualize many data sets, and some of the data points are obvious outliers, but just as many (or more) fall in a gray area—especially if they're sneaky inliers. z-score, MAD, modified z-score, interquartile range (IQR), time-series decomposition, smoothing, forecasting, and many other techniques are available to the analyst for detecting outliers. Depending on the data, though, the most appropriate method (or combination of methods) for identifying outliers can change! We sat down with Brett Kennedy, author of Outlier Detection in Python, to dig into the topic! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.