The Analytics Power Hour

KPIs? Really? It’s 2024. Can’t we just ask Claude to generate those for us? We say… no. There are lots and lots of things that AI can take on or streamline, but getting meaningful, outcome-oriented alignment within a set of business partners as they plan a campaign, project, or initiative isn’t one of them! Or, at least, we’re pretty sure that’s what our special guest for this episode would say. He’s been thinking about (and ranting about) organizations’ failure to take goal establishment, KPI identification, and target-setting seriously enough for years (we found a post he wrote in 2009 on the subject!). He also really helped us earn our explicit tag for this episode — scatologically and onanistically, we’re afraid. But solid content nonetheless, so hopefully you can hear past that! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

udging by the number of inbound pitches we get from PR firms, AI is absolutely going to replace most of the work of the analyst some time in the next few weeks. It’s just a matter of time until some startup gets enough market traction to make that happen (business tip: niche podcasts are likely not a productive path to market dominance, no matter what Claude from Marketing says). We’re skeptical. But that doesn’t mean we don’t think there are a lot of useful applications of generative AI for the analyst. We do! As Moe posited in this episode, one useful analogy is that thinking of using generative AI effectively is like getting a marketer effectively using MMM when they’ve been living in an MTA world (it’s more nuanced and complicated). Our guest (NOT from a PR firm solicitation!), Martin Broadhurst, agreed: it’s dicey to fully embrace generative AI without some understanding of what it’s actually doing. Things got a little spicy, but no humans or AI were harmed in the making of the episode.

For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

For the first time since they've been a party of five, all of the Analytics Power Hour co-hosts assembled in the same location. That location? The Windy City. The occasion? Chicago's first ever MeasureCamp! The crew was busy throughout the day inviting attendees to "hop on the mic" with them to answer various questions. We covered everything from favorite interview questions to tips and tricks, with some #hottake questions thrown in for fun. During the happy hour at the end of the day, we also recorded a brief live show, which highlighted some of the hosts' favorite moments from the day. Listen carefully and you'll catch an audio cameo from Tim's wife, Julie! And keep an eye on the MeasureCamp website to find the coolest way to spend a nerdy Saturday near you (Bratislava, Sydney, Dubai, Stockholm, Brussels, and Istanbul are all coming up before the end of the year!). For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

To data analyst, or to data science? To individually contribute, or to manage the individual contributions of others? To mid-career pivot into analytics, or to… oh, hell yes! That last one isn’t really a choice, is it? At least, not for listeners who are drawn to this podcast. And this episode is a show that can be directly attributed to listeners. As we gathered feedback in our recent listener survey, we asked for topic suggestions, and a neat little set of those suggestions were all centered around career development. And thus, a show was born! All five co-hosts—Julie, Michael, Moe, Tim, and Val—hopped on the mic to collaborate on some answers in this episode. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

It's human nature to want to compare yourself or your organization against your competition, but how valuable are benchmarks to your business strategy? Benchmarks can be dangerous. You can rarely put your hands on all the background and context since, by definition, benchmark data is external to your organization. And you can also argue that benchmarks are a lazy way to evaluate performance, or at least some co-hosts on this episode feel that way! Eric Sandosham, founder and partner at Red & White Consulting Partners (and prolific writer), along with Moe, Tim, and Val break down the problems with benchmarking and offer some alternatives to consider when you get the itch to reach for one! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

While we don’t often call it out explicitly, the driving force behind much of what and how much data we collect is driven by a "just in case" mentality: we don't know exactly HOW that next piece of data will be put to use, but we better collect it to minimize the potential for future regret about NOT collecting it. Data collection is an optionality play—we strive to capture "all the data" so that we have as many potential options as possible for how it gets crunched somewhere down the road. On this episode, we explored the many ways this deeply ingrained and longstanding mindset is problematic, and we were joined by the inimitable Matt Gershoff from Conductrics for the discussion! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

Broadly writ, we’re all in the business of data work in some form, right? It’s almost like we’re all swimming around in a big data lake, and our peers are swimming around it, too, and so are our business partners. There might be some HiPPOs and some SLOTHs splashing around in the shallow end, and the contours of the lake keep changing. Is lifeguarding…or writing SQL…or prompt engineering to get AI to write SQL…or identifying business problems a job or a skill? Does it matter? Aren’t we all just trying to get to the Insights Water Slide? Katie Bauer, Head of Data at Gloss Genius and thought-provoker at Wrong But Useful, joined Michael, Julie, and Val for a much less metaphorically tortured exploration of the ever-shifting landscape in which the modern data professional operates. Or swims. Or sinks? For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

We're seeing the title "Analytics Engineer" continue to rise, and it’s in large part due to individuals realizing that there's a name for the type of work they've found themselves doing more and more. In today's landscape, there's truly a need for someone with some Data Engineering chops with an eye towards business use cases. We were fortunate to have the one of the co-authors of The Fundamentals of Analytics Engineering, Dumky de Wilde, join us to discuss the ins and outs of this popular role! Listen in to hear more about the skills and responsibilities of this role, some fun analogies to help explain to your grandma what AE's do, and even tips for individuals in this role for how they can communicate the value and impact of their work to senior leadership! For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

A claim: in the world of business analytics, the default/primary source of data is real world data collected through some form of observation or tracking. Occasionally, when the stakes are sufficiently high and we need stronger evidence, we'll run some form of controlled experiment, like an A/B test. Contrast that with the world of healthcare, where the default source of data for determining a treatment's safety and efficacy is a randomized controlled trial (RCT), and it's only been relatively recently that real world data (RWD) -- data available outside of a rigorously controlled experiment -- has begun to be seen as a useful complement. On this episode, medical statistician Lewis Carpenter, Director of Real World Evidence (there's an acronym for that, too: RWE!) at Arcturis, joined Tim, Julie, and Val for a fascinating compare and contrast and caveating of RWD vs. RCTs in a medical setting and, consequently, what horizons that could broaden for the analyst working in more of a business analytics role. For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the show page.

How good are humans at distinguishing between human-generated thoughts and AI-generated…thoughts? Could doing an extremely unscientific exploration of the question also generate some useful discussion? We decided to dig in and find out with a show recorded in front of a live audience at Marketing Analytics Summit in Phoenix! With Michael in the role of Peter Sagal, Julie, Tim, and Val went head-to-GPU by answering a range of analytics-oriented questions. Two co-hosts delivered their own answers, and one co-host delivered ChatGPT's, and the audience had to figure out which was which. Plus, a bit of audience Q&A, which included Michael channeling his inner Charlie Day! This episode also features the walk-on music that was written and performed live by Josh Silverbauer (no relation to Josh Crowhurst, the producer of this very podcast who also wrote and recorded the show's standard intro music; what is it about guys named Josh?!). For complete show notes, including links to items mentioned in this episode and a transcript of the show, visit the  show page.