AI Daily

HierVST Voice Cloning | NVIDIA Perfusion | Meta's AudioCraft


Listen Later

Welcome to AI Daily! Join hosts Farb, Ethan, and Conner as they explore three groundbreaking AI stories First up, HierVST Voice Cloning - Experience zero-shot voice cloning with impressive accuracy using just one audio clip. Next, NVIDIA Perfusion - a small, powerful personalization model for text images, using key locking to maintain consistency. Lastly, Meta's AudioCraft - the fusion of music generation, audio generation, and codecs into one open-source code base, creating high-fidelity outputs.

Quick Points

1️⃣ HierVST Voice Cloning

* Zero-shot voice cloning system achieves accurate outputs with just one audio clip.

* Uses hierarchical models for long and short-term generation understanding.

* Potential challenges in handling longer clips and need for further fine-tuning.

2️⃣ NVIDIA Perfusion

* Personalization model for text images with key locking for subject consistency.

* Only 100 kilobytes, trains in four minutes, and outperforms other models.

* Open-source codebase, but may need improvements for human subjects.

3️⃣ Meta’s AudioCraft

* Audio generation, music gen, and codecs combined into an open-source codebase.

* High-fidelity outputs, 30 seconds of sounds, compressing audio files efficiently.

* Meta making strides in audio AI, impressively opens research use for community.

🔗 Episode Links

* HierVST Voice Cloning

* NVIDIA Perfusion

* Meta's AudioCraft

* ChatGPT String Tweet

* Apple App Store/China Story

Connect With Us:

Follow us on Threads

Subscribe to our Substack

Follow us on Twitter:

* AI Daily

* Farb

* Ethan

* Conner



This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.aidailypod.com
...more
View all episodesView all episodes
Download on the App Store

AI DailyBy Daily insights on the latest news, innovations, and tools in the world of AI.

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

9 ratings


More shows like AI Daily

View all
Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,570 Listeners

The Daily by The New York Times

The Daily

112,823 Listeners

Wow in the World by Tinkercast | Wondery

Wow in the World

29,985 Listeners

Modern Wisdom by Chris Williamson

Modern Wisdom

3,872 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,567 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,873 Listeners

Hard Fork by The New York Times

Hard Fork

5,524 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,158 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,049 Listeners

Money For Couples with Ramit Sethi by Ramit Sethi

Money For Couples with Ramit Sethi

3,405 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

209 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

595 Listeners

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic by Jaeden Schafer and Conor Grennan

AI Applied: Covering AI News, Interviews and Tools - ChatGPT, Midjourney, Gemini, OpenAI, Anthropic

146 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,401 Listeners

AI DAILY: Breaking AI News Handpicked For The Curious Mind by Chris Kalaboukis

AI DAILY: Breaking AI News Handpicked For The Curious Mind

3 Listeners