Intellectually Curious

AI Disproves the Benjamini–Hochberg Conjecture


Listen Later

The false discovery rate (FDR) is a statistical framework designed to manage the proportion of incorrect "discoveries" when conducting multiple hypothesis tests simultaneously. Historically, researchers relied on the Benjamini-Hochberg (BH) procedure, which was widely believed to guarantee that the rate of false positives remained below a target threshold across all scenarios. However, a recent mathematical breakthrough by Edgar Dobriban utilizes an AI-assisted proof to demonstrate that this standard method can fail under specific conditions involving correlated two-sided Gaussian tests. By constructing a complex factor model, the research proves that dependencies between variables can cause the actual error rate to exceed the intended limit. This discovery refutes a long-standing statistical conjecture and suggests that traditional FDR controls may require adjustment for high-throughput data analysis. 


Note:  This podcast was AI-generated, and sometimes AI can make mistakes.  Please double-check any critical information.

Sponsored by Embersilk LLC

...more
View all episodesView all episodes
Download on the App Store

Intellectually CuriousBy Mike Breault