Data Science at Home

Run massive models on crappy machines (Ep. 279)


Listen Later

AI shouldn’t be limited to those with access to expensive hardware. This episode explores how to break down barriers by running massive AI models on "crappy machines"—affordable, low-spec devices. Clever techniques like quantization, pruning, model distillation might not be enough.

With edge offloading, we can make state-of-the-art AI accessible to hobbyists, researchers, and innovators everywhere.

By democratizing AI, we can empower individuals and small teams to experiment, create, and solve problems without needing deep pockets or enterprise-grade resources.

 

AI for everyone, on everything. Let’s make it happen.

 

 

✨ Connect with us!

📩 Newsletter: https://datascienceathome.substack.com

🎙 Podcast: Available on Spotify, Apple Podcasts, and more.

🐦 Twitter: @DataScienceAtHome

📘 LinkedIn: https://www.linkedin.com/in/fragadaleta/

Instagram: https://www.instagram.com/datascienceathome/

Facebook: https://www.facebook.com/datascienceAH

LinkedIn: https://www.linkedin.com/company/data-science-at-home-podcast

Discord Channel: https://discord.gg/4UNKGf3

 

NEW TO DATA SCIENCE AT HOME?

Welcome! Data Science at Home explores the latest in AI, data science, and machine learning. Whether you’re a data professional, tech enthusiast, or just curious about the field, our podcast delivers insights, interviews, and discussions. Learn more at https://datascienceathome.com

 

SEND US MAIL!

We love hearing from you! Send us mail at:

Don’t forget to like, subscribe, and hit the 🔔 for updates on the latest in AI and data science!

...more
View all episodesView all episodes
Download on the App Store

Data Science at HomeBy Francesco Gadaleta

  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

72 ratings


More shows like Data Science at Home

View all
Data Skeptic by Kyle Polich

Data Skeptic

481 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

590 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

298 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

331 Listeners

Data Engineering Podcast by Tobias Macey

Data Engineering Podcast

141 Listeners

DataFramed by DataCamp

DataFramed

267 Listeners

Techmeme Ride Home by Brian McCullough

Techmeme Ride Home

944 Listeners

Practical AI by Practical AI LLC

Practical AI

192 Listeners

The Real Python Podcast by Real Python

The Real Python Podcast

139 Listeners

Last Week in AI by Skynet Today

Last Week in AI

298 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

88 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

201 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

75 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

491 Listeners

Lightcone Podcast by Y Combinator

Lightcone Podcast

22 Listeners