Tech Talks Daily

1343: The Deep Learning Accelerator Enabling AI Deployments


Listen Later

Most AI breakthroughs are driven by deep learning. However, current models and deployment methods suffer from significant limitations, like large energy and memory consumption, high costs, and hyper-specific hardware. Hardware advancements have gotten deep learning deployments this far, but for AI to meet its full potential, a software accelerator approach is required.

Dr. Eli David, a pioneering researcher in deep learning and neural networks, has focused his research on the development of deep learning technologies that improve the real-world deployment of AI systems, and believes the key lies in software. Bringing his research to fruition, Eli has developed DeepCube, a software-based inference accelerator that can be deployed on top of existing hardware (CPU, GPU, ASIC) in both datacenters and edge devices to improve deep learning speed, efficiency, and memory drastically.

For example, some of his results include:

•Increasing the inference speed on a regular CPU to match and surpass that of a GPU, which costs several times more •Increasing the inference speed on a GPU to equal the performance of 10 GPUs

...more
View all episodesView all episodes
Download on the App Store

Tech Talks DailyBy Neil C. Hughes

  • 5
  • 5
  • 5
  • 5
  • 5

5

197 ratings


More shows like Tech Talks Daily

View all
HBR IdeaCast by Harvard Business Review

HBR IdeaCast

1,830 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,032 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

519 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners

The Official SaaStr Podcast: SaaS | Founders | Investors by SaaStr

The Official SaaStr Podcast: SaaS | Founders | Investors

175 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

441 Listeners

Fintech Insider Podcast by 11:FS by 11:FS

Fintech Insider Podcast by 11:FS

186 Listeners

Gartner ThinkCast by Gartner

Gartner ThinkCast

112 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

298 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

322 Listeners

DataFramed by DataCamp

DataFramed

267 Listeners

Practical AI by Practical AI LLC

Practical AI

192 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

442 Listeners

Business Breakdowns by Colossus | Investing & Business Podcasts

Business Breakdowns

351 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

462 Listeners