Tech Leader Pro

Tech Leader Pro podcast 2023 week 29, never accept statistics on face value

Listen Later

I have seen many instances both in my career, and in life in general, of garbage statistics presented in reports being accepted on face value. Why is this, and what can we do to challenge it?

Notes:

  • In my teams we deal with very large volumes of data, but in a controlled ecosystem.
  • Even with controls in place, I regularly see statistical reports from different sources that contradict each other on the same topic.
  • I like to joke that everyone has their own reports, based on their own copies of the data, about the same topic.
  • We should never, ever, blindly trust statistical reports.
  • The reason for this is simple: people produced the reports, and with the best will in the world, people are flawed.
  • Usually the flaw in question here is bias.
  • As a leader, to mitigate challenge on:
    1. Data sources?
    2. Loading process?
    3. Peer reviewed?
    4. Sample size?
    5. Before and after data sets?
    6. Be scientific.
    7. To put it bluntly: if you accept garbage on face value without questioning it, you will be fed more garbage.
    8. What I am working on this week:
      • Running late on leadership podcast and blogging in general.
      • Joined Twitter Blue.
      • Media I am enjoying this week:
        • Foundation season 2
        • Longitude by Dava Sobel

          • Notes and subscription links are here: https://techleader.pro/a/600-Tech-Leader-Pro-podcast-2023-week-29,-never-accept-statistics-on-face-value

          ...more
          View all episodesView all episodes
          Download on the App Store
          Tech Leader ProBy John Collins