Software Testing Unleashed - QA, DevEx & Quality Engineering

Metrics: Asset or Trap? - Jani Grönman


Listen Later

The KPI pairs that keep you honest.

Tip: This is how much money is saved by testing 👈🏻

"If you cannot measure what you change, it's really hard to lead the change and it's really hard to understand are you doing something right or should you try something else?" - Jani Grönman

In this episode, I talk with Jani Grönman about KPIs for quality. We ask what to measure, and why. Jani shares pairs that keep teams honest. Test pass rate with escaped defects or flaky tests. Mean time to recovery with reopen rate. Lead time to production with customer impact. One team, one number. Keep it to three or four KPIs, own them, and act. We talk about agency at work and product sense. Your tests are not a scoreboard. They are a feedback loop. Bring product and engineering together, do root cause analysis. I left inspired to pick fewer numbers, tell stories, and ship with care.

Jani works as a Managing Partner at Hidden Trail, his mission being turning quality from a cost into competitive advantage.

Hidden Trail is a Digital Product Quality consultancy with clients in Scandinavia, Central Europe and the Americas. In Hidden Trail Jani leads advisory and transformation projects that tackle complex quality related development needs within his client companies. This means working with teams, management, product people, developers and testers to recognize where their product quality comes from and how to make it a tangible asset. Jani has 20+ years experience in software industry, during which he has worked with many teams in managerial, development and quality related roles. Jani firmly believes that quality means business!

Highlights:

  • Pair KPIs to prevent gaming and reveal tradeoffs
  • Test pass rate means little without escaped defects and flakiness data
  • Connect lead time and MTTR with customer impact and reopen rate
  • Keep three to four team KPIs and act on them
  • Treat tests as a feedback loop, not a scoreboard
  • ...more
    View all episodesView all episodes
    Download on the App Store

    Software Testing Unleashed - QA, DevEx & Quality EngineeringBy Richard Seidl | Software Development & Testing Expert