Microsoft Research Podcast

Abstracts: December 6, 2023

12.06.2023 - By Researchers across the Microsoft research communityPlay

Download our free app to listen on your phone

Download on the App StoreGet it on Google Play

Members of the research community at Microsoft work continuously to advance their respective fields. Abstracts brings its audience to the cutting edge with them through short, compelling conversations about new and noteworthy achievements.In this episode, Xing Xie (https://www.microsoft.com/en-us/research/people/xingx/), a Senior Principal Research Manager of Microsoft Research Asia, joins host Dr. Gretchen Huizinga to discuss “Evaluating General-Purpose AI with Psychometrics.” As AI capabilities move from task specific to more general purpose, the paper explores psychometrics, a subfield of psychology, as an alternative to traditional methods for evaluating model performance and for supporting consistent and reliable systems.Read the paper: Evaluating General-Purpose AI with Psychometrics (https://www.microsoft.com/en-us/research/publication/evaluating-general-purpose-ai-with-psychometrics/)

More episodes from Microsoft Research Podcast