The Effective Statistician - in association with PSI

Top 9: Non-parametric analyses - much more than just the Wilcoxon test!


Listen Later

Interview with Frank Konietschke
Why You Should Listen:

Why this episode made our all-time Top 9: If you’ve ever thought “non-parametric = Wilcoxon/Mann-Whitney and that’s it,” this conversation will happily destroy that myth. Frank shows how rank-based methods unlock rigorous analyses for skewed data, outliers, ordinal endpoints, small samples, composites/estimands—and how to communicate effects without relying on means.

You’ll walk away with:

Non-parametric ≠ one test: A broad toolkit for two-group, multi-group, longitudinal, factorial, and covariate-adjusted designs.

When ranks shine: Ordinal scales, heavy skew, small n (e.g., preclinical/animal studies), outliers, composite endpoints under the estimand framework.

Interpretable effects without means: The probability-based “relative treatment effect”—“What’s the chance a random patient on A does better than a random patient on B?”

Link to parametrics (when you must): How the rank-based effect relates to standardized mean differences under normality.

Presenting results: Confidence intervals for rank-based effects and clean visualizations.

Software exists: SAS macros and R packages for rank-based models (plus pointers to Frank’s book).

Missing data & estimands: Practical thinking about composite strategies, treatment policy, and ongoing research for rank methods with missingness.

Episode Highlights:

00:00 – 03:31 | Welcome & setup
TES resources, PSI community, and why innovative methods often struggle with adoption.

03:32 – 06:00 | Meet Frank
From Göttingen to Munich, Texas, and back to Berlin; preclinical research focus.

06:01 – 09:11 | What are non-parametric analyses?
No strict distributional model; works for metric, ordinal, and binary data.

09:12 – 12:13 | Why ranks?
Small samples, unknown distributions; robustness when outliers occur.

12:14 – 14:35 | Where ranks are the better choice
Ordinal ratings (A/B/C/… without meaningful distances), outliers, skew, composites.

14:36 – 21:18 | Defining the treatment effect without means
Relative treatment effect as a probability (e.g., 60% = in 60% of random pairings, new treatment is better).
Connection to parametric world under normality assumptions.

21:19 – 23:13 | How to present it
Confidence intervals for rank-based effects and clear plots.

23:14 – 30:18 | Beyond two groups
Multi-arm trials, repeated measures, factorial designs, covariate adjustments; pseudo-ranks and why unweighted references improve interpretability and power properties.

30:19 – 35:33 | Missing data, real-world setups & estimands
Practical strategies (composites, treatment policy) and active research on rank methods with missingness.

35:34 – 39:41 | Collaboration & wrap-up
Research networks, software, and how statisticians can lead method adoption.

References:
  • Book: Brunner, E., Bathke, A.C., Konietschke, F. (2019).  Rank and Pseudo-Rank Procedures for Independent Observations in Factorial Designs -Using R and SAS. Springer
  • Brunner, E., Konietschke, F., Pauly, M., & Puri, M. L. (2017). Rank‐based procedures in factorial designs: hypotheses about non‐parametric treatment effects. Journal of the Royal Statistical Society: Series B (Statistical Methodology)79(5), 1463-1485.
  • Konietschke, F., Bathke, A. C., Hothorn, L. A., & Brunner, E. (2010). Testing and estimation of purely nonparametric effects in repeated measures designs. Computational Statistics & Data Analysis54(8), 1895-1905.
  • Konietschke, F., Hothorn, L. A., & Brunner, E. (2012). Rank-based multiple test procedures and simultaneous confidence intervals. Electronic Journal of Statistics6, 738-759.
  • Konietschke, F., Harrar, S. W., Lange, K., & Brunner, E. (2012). Ranking procedures for matched pairs with missing data—asymptotic theory and a small sample approximation. Computational Statistics & Data Analysis56(5), 1090-1102.
  • Links:

    🔗 The Effective Statistician Academy – I offer free and premium resources to help you become a more effective statistician.

    🔗 Medical Data Leaders Community – Join my network of statisticians and data leaders to enhance your influencing skills.

    🔗 My New Book: How to Be an Effective Statistician - Volume 1 – It’s packed with insights to help statisticians, data scientists, and quantitative professionals excel as leaders, collaborators, and change-makers in healthcare and medicine.

    🔗 PSI (Statistical Community in Healthcare) – Access webinars, training, and networking opportunities.

    Join the Conversation:
    Did you find this episode helpful? Share it with your colleagues and let me know your thoughts! Connect with me on LinkedIn and be part of the discussion.

    Subscribe & Stay Updated:
    Never miss an episode! Subscribe to The Effective Statistician on your favorite podcast platform and continue growing your influence as a statistician.

    ...more
    View all episodesView all episodes
    Download on the App Store

    The Effective Statistician - in association with PSIBy Alexander Schacht and Benjamin Piske, biometricians, statisticians and leaders in the pharma industry

    • 4.4
    • 4.4
    • 4.4
    • 4.4
    • 4.4

    4.4

    9 ratings


    More shows like The Effective Statistician - in association with PSI

    View all
    Stuff You Should Know by iHeartPodcasts

    Stuff You Should Know

    78,335 Listeners

    Freakonomics Radio by Freakonomics Radio + Stitcher

    Freakonomics Radio

    32,111 Listeners

    Planet Money by NPR

    Planet Money

    30,667 Listeners

    Hidden Brain by Hidden Brain, Shankar Vedantam

    Hidden Brain

    43,709 Listeners

    Pivot by New York Magazine

    Pivot

    9,529 Listeners

    JAMA Clinical Reviews by JAMA Network

    JAMA Clinical Reviews

    498 Listeners

    HBR IdeaCast by Harvard Business Review

    HBR IdeaCast

    176 Listeners

    Page 94: The Private Eye Podcast by Page 94: The Private Eye Podcast

    Page 94: The Private Eye Podcast

    350 Listeners

    The Peter Attia Drive by Peter Attia, MD

    The Peter Attia Drive

    9,152 Listeners

    The Journal. by The Wall Street Journal & Spotify Studios

    The Journal.

    6,072 Listeners

    Huberman Lab by Scicomm Media

    Huberman Lab

    29,216 Listeners

    Biotech Hangout by Daphne Zohar, Josh Schimmer, Brad Loncar, Tim Opler & more

    Biotech Hangout

    19 Listeners

    The Rest Is Politics by Goalhanger

    The Rest Is Politics

    3,080 Listeners

    DER TRUMP EFFEKT  –  ZDF auslandsjournal – Der Podcast by ZDF

    DER TRUMP EFFEKT – ZDF auslandsjournal – Der Podcast

    16 Listeners

    Die Peter Thiel Story by Deutschlandfunk

    Die Peter Thiel Story

    26 Listeners