Microsoft Research Podcast

AI Frontiers: The future of scale with Ahmed Awadallah and Ashley Llorens


Listen Later

Powerful large-scale AI models like GPT-4 are showing dramatic improvements in reasoning, problem-solving, and language capabilities. This marks a phase change for artificial intelligence—and a signal of accelerating progress to come.  

In this Microsoft Research Podcast series, AI scientist and engineer Ashley Llorens hosts conversations with his collaborators and colleagues about what these models—and the models that will come next—mean for our approach to creating, understanding, and deploying AI, its applications in areas such as healthcare and education, and its potential to benefit humanity.

This episode features Senior Principal Research Manager Ahmed H. Awadallah, whose work improving the efficiency of large-scale AI models and efforts to help move advancements in the space from research to practice have put him at the forefront of this new era of AI. Awadallah discusses the shift in dynamics between model size and amount—and quality—of data when it comes to model training; the recently published paper “Orca: Progressive Learning from Complex Explanation Traces of GPT-4,” which further explores the use of large-scale AI models to improve the performance of smaller, less powerful ones; and the need for better evaluation strategies, particularly as we move into a future in which Awadallah hopes to see gains in these models’ ability to continually learn.

Learn more:

  • Orca: Progressive Learning from Complex Explanation Traces of GPT-4, June 2023 
  • Textbooks Are All You Need II: phi-1.5 technical report, September 2023
  • AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework, August 2023 
  • LIDA: Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models, March 2023
  • AI Explainer: Foundation models ​and the next era of AI, March 2023 
  • AI and Microsoft Research
...more
View all episodesView all episodes
Download on the App Store

Microsoft Research PodcastBy Researchers across the Microsoft research community

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

80 ratings


More shows like Microsoft Research Podcast

View all
a16z Podcast by Andreessen Horowitz

a16z Podcast

1,055 Listeners

Data Skeptic by Kyle Polich

Data Skeptic

476 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

439 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

297 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

341 Listeners

The Future of Everything by Stanford Engineering

The Future of Everything

127 Listeners

AI Today Podcast by AI & Data Today

AI Today Podcast

150 Listeners

Practical AI by Practical AI LLC

Practical AI

189 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

195 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

91 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

454 Listeners

MIT Technology Review Narrated by MIT Technology Review

MIT Technology Review Narrated

256 Listeners

WorkLab by Microsoft

WorkLab

58 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

71 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

504 Listeners