The Post-Quantum World

Quantum AI Compression: Smaller LLMs without Losing Performance — with Sam Mugel of Multiverse


Listen Later

Large language models are … large. Forget Bitcoin and recharging electric vehicles; the grid could be toppled by powering AI in a few years. It would be optimal if AI could run on more underpowered edge devices. What if there was a quantum-inspired way to make LLMs smaller without sacrificing overall performance in combined metrics? We explore a way to do that and other advanced ideas, like selectively removing information from models, in this episode. Join Host Konstantinos Karagiannis for a chat about how businesses can solve many of the woes associated with bringing AI in-house with Sam Mugel from Multiverse.  
For more on Multiverse, visit https://multiversecomputing.com/.  
Read the CompactifAI paper: https://arxiv.org/abs/2401.14109.  
Visit Protiviti at www.protiviti.com/US-en/technology-consulting/quantum-computing-services  to learn more about how Protiviti is helping organizations get post-quantum ready.  
Follow host Konstantinos Karagiannis on all socials: @KonstantHacker and follow Protiviti Technology on LinkedIn and Twitter: @ProtivitiTech.     
Questions and comments are welcome!   
Theme song by David Schwartz, copyright 2021.   
The views expressed by the participants of this program are their own and do not represent the views of, nor are they endorsed by, Protiviti Inc., The Post-Quantum World, or their respective officers, directors, employees, agents, representatives, shareholders, or subsidiaries.  None of the content should be considered investment advice, as an offer or solicitation of an offer to buy or sell, or as an endorsement of any company, security, fund, or other securities or non-securities offering. Thanks for listening to this podcast. Protiviti Inc. is an equal opportunity employer, including minorities, females, people with disabilities, and veterans.
...more
View all episodesView all episodes
Download on the App Store

The Post-Quantum WorldBy Protiviti

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

21 ratings


More shows like The Post-Quantum World

View all
Economist Podcasts by The Economist

Economist Podcasts

4,255 Listeners

Bloomberg Surveillance by Bloomberg

Bloomberg Surveillance

1,185 Listeners

Energy Gang by Wood Mackenzie

Energy Gang

1,255 Listeners

The Quanta Podcast by Quanta Magazine

The Quanta Podcast

481 Listeners

Odd Lots by Bloomberg

Odd Lots

1,765 Listeners

Macro Voices by Hedge Fund Manager Erik Townsend

Macro Voices

3,077 Listeners

Azeem Azhar's Exponential View by Azeem Azhar

Azeem Azhar's Exponential View

607 Listeners

EU Confidential by POLITICO

EU Confidential

106 Listeners

Physics World Weekly Podcast by Physics World

Physics World Weekly Podcast

75 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,105 Listeners

The Intelligence from The Economist by The Economist

The Intelligence from The Economist

2,516 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

410 Listeners

Catalyst with Shayle Kann by Latitude Media

Catalyst with Shayle Kann

259 Listeners

The Joy of Why by Steven Strogatz, Janna Levin and Quanta Magazine

The Joy of Why

490 Listeners

The Superposition Guy's Podcast by Yuval Boger

The Superposition Guy's Podcast

4 Listeners