Brownstone Journal

Response Rates in Psychiatric Drug Trials Are Statistical Nonsense


Listen Later

By Peter C. Gøtzsche at Brownstone dot org
The outcomes used in psychiatric drug trials are not meaningful, and psychiatric diagnoses and names of drug classes are also problematic. According to DSM-5, major depression "causes clinically significant distress or impairment in social, occupational, or other important areas of functioning." 1, It is the other way around.
People become depressed because they have difficulties in their lives, not because they are attacked by some depression monster that can be killed with so-called antidepressants, like antibiotics that can kill bacteria.
The patients want to have normal levels of functioning and to enjoy a meaningful life. 2, Yet, I have not seen a single placebo-controlled trial of depression drugs that reported on such outcomes except one, which was unethical because the drugs were abruptly withdrawn in half the patients, which harmed them substantially, as they developed abstinence symptoms. 3, Patients on paroxetine reported statistically significant deterioration in functioning at work, relationships, social activities, and
overall functioning.
The study was sponsored by Eli Lilly, the manufacturer of fluoxetine, which has an active metabolite with a half-life of one to two weeks. Thus, little harm will be done to patients on fluoxetine during a five-day period where the drug was changed to placebo unbeknownst to the patients.
The outcomes in psychiatric drug trials are measured on rating scales even though the results cannot tell us whether the patients have improved in any way that is important for them.
But we can exclude this possibility because the effects obtained with such scales are considerably lower than the least clinically relevant difference to placebo, both for depression drugs and psychosis drugs. 4, Thus, the drugs don't work, not even for very severe degrees of depression. 4, This is not what the patients are being told.
Statistical Hocus Pocus
We constantly hear about large effects of psychiatric drugs. This is usually because data on a ranking scale are dichotomised into the number of patients improved in an act of statistical hocus pocus.
A recent anonymous editorial in the Lancet illustrates this. 5, It quoted a 2018 network meta-analysis by Cipriani et al., 6, noting that "all antidepressants are more efficacious than placebo in adults with a diagnosis of major depressive disorder, with odds ratios ranging between 2.23 and 1.37" (there was no average for all the drugs in the meta-analysis but it would have been around 1.7).
An almost doubling of the response rate looks very impressive but it wasn't. 7, Cipriani et al. also reported that the standardised mean difference was only 0.30, similar to other meta-analyses. 8, 9.
The difference to placebo is only about 2 on the Hamilton depression scale, 6, and 8 through 10, far less than what is clinically relevant. The smallest effect that can be perceived on this scale is 5 to 6, 11, and the minimal clinically relevant effect is of course larger than the bare minimum that can be perceived.
It is highly misleading to dichotomise data on a ranking scale and report on patients who have improved by a certain amount. This statistical hocus pocus spins straw into gold transforming ineffectiveness into the much-trumpeted idea that antidepressants work, 12, as expressed in a headline in the Guardian when the Cipriani meta-analysis was published. 13, By categorising people into responders and non-responders, Cipriani et al.
transformed a tiny 2 point difference in depression symptoms scores, 10, into the illusion that you are twice as likely to respond if you take a depression drug compared to placebo.
The "response" that is reported in trials is an artificial figure constructed by categorising the data using an arbitrary cut-off point. There is no natural distinction between showing a response and not showing a response. 12, People improve to different degrees.
Unsurprisingly, statisticians have advised not to cate...
...more
View all episodesView all episodes
Download on the App Store

Brownstone JournalBy Brownstone Institute

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

12 ratings


More shows like Brownstone Journal

View all
Peak Prosperity by Chris Martenson

Peak Prosperity

567 Listeners

Wise Traditions by Weston A. Price Foundation

Wise Traditions

2,346 Listeners

Gold Goats 'n Guns Podcast by Tom Luongo

Gold Goats 'n Guns Podcast

336 Listeners

Coffee and a Mike by Michael Farris

Coffee and a Mike

374 Listeners

The Delingpod: The James Delingpole Podcast by James Delingpole

The Delingpod: The James Delingpole Podcast

462 Listeners

American Thought Leaders by The Epoch Times

American Thought Leaders

1,213 Listeners

DarkHorse Podcast by Bret Weinstein & Heather Heying

DarkHorse Podcast

5,372 Listeners

The Sharyl Attkisson Podcast by Sharyl Attkisson

The Sharyl Attkisson Podcast

1,832 Listeners

Bannon`s War Room by WarRoom.org

Bannon`s War Room

16,791 Listeners

THE MCCULLOUGH REPORT by Dr. Peter McCullough

THE MCCULLOUGH REPORT

2,486 Listeners

Facts Matter by The Epoch Times

Facts Matter

1,266 Listeners

Man in America Podcast by Man in America

Man in America Podcast

497 Listeners

Doc Malik by Ahmad Malik

Doc Malik

125 Listeners

The Tucker Carlson Show by Tucker Carlson Network

The Tucker Carlson Show

16,982 Listeners

Victor Davis Hanson: In His Own Words by Victor Davis Hanson | The Daily Signal

Victor Davis Hanson: In His Own Words

1,123 Listeners