Sign up to save your podcasts
Or
Share Atropos Health’s Arjun Mukerji, PhD, Explains RWESummary: A Framework and Test for Choosing LLMs to Summarize Real-World Evidence (RWE) Studies
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Atropos Health’s Arjun Mukerji, PhD, Explains RWESummary: A Framework and Test for Choosing LLMs to Summarize Real-World Evidence (RWE) Studies
Large language models are increasingly used to turn complex study output into plain-English summaries. But how do we know which models are safest and most reliable for healthcare?
In this most recent community AI research paper reading, Arjun Mukerji, PhD – Staff Data Scientist at Atropos Health – walks us through RWESummary, a new benchmark designed to evaluate LLMs on summarizing real-world evidence from structured study output — an important but often under-tested scenario compared to the typical “summarize this PDF” task.
Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.
View all episodes
By Arize AI
5
1515 ratings
Large language models are increasingly used to turn complex study output into plain-English summaries. But how do we know which models are safest and most reliable for healthcare?
In this most recent community AI research paper reading, Arjun Mukerji, PhD – Staff Data Scientist at Atropos Health – walks us through RWESummary, a new benchmark designed to evaluate LLMs on summarizing real-world evidence from structured study output — an important but often under-tested scenario compared to the typical “summarize this PDF” task.
Learn more about AI observability and evaluation, join the Arize AI Slack community or get the latest on LinkedIn and X.
More shows like Deep Papers
View all
Freakonomics Radio
32,034 Listeners
Profile
106 Listeners
The Quanta Podcast
535 Listeners
Into the Impossible With Brian Keating
1,066 Listeners
The Daily
111,888 Listeners
Y Combinator Startup Podcast
227 Listeners
Physics World Weekly Podcast
83 Listeners
The Journal.
6,071 Listeners
Google DeepMind: The Podcast
208 Listeners
Americast
719 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,008 Listeners
Machine Learning Street Talk (MLST)
95 Listeners
Dwarkesh Podcast
519 Listeners
Hard Fork
5,522 Listeners
Latent Space: The AI Engineer Podcast
92 Listeners