Tech Field Day Podcast

62. A Different Type of Datacenter is Needed for AI


Listen Later

Learn More from the AI Infrastructure Field Day Presentations

AI demands specialized data center designs due to its unique hardware utilization and networking needs, which require a new type of infrastructure. This Tech Field Day Podcast episode features Denise Donohue, Karen Lopez, Lino Telera, and Alastair Cooke. Network design has been a consistent part of the AI infrastructure discussions at Tech Field Day events. The need for a dedicated network to interconnect GPUs differentiates AI training and fine-tuning networks from general-purpose computing. The vast power demand for high-density GPU servers highlights a further need for different data centers with liquid cooling and massive power distribution. Model training is only one part of the AI pipeline; business value is delivered by AI inference with a different set of needs and a closer eye on financial management. Inference will likely require servers with GPUs and high-speed local storage, but not the same networking density as training and fine-tuning. Inference will also need servers adjacent to existing general-purpose infrastructure running existing business applications. Some businesses may be able to fit their AI applications into their existing data centers, but many will need to build or rent new infrastructure.

Host

Alastair Cooke, Tech Field Day Event Lead

Panelists:

Karen Lopez

Lino Telera

Denise Donohue

Follow the Tech Field Day Podcast ⁠⁠⁠on X/Twitter⁠⁠⁠ or ⁠⁠⁠on Bluesky⁠⁠⁠ and use the Hashtag #TFDPodcast to join the discussion. Listen to more episodes ⁠⁠⁠on the podcast page of the website⁠⁠⁠.

Follow ⁠⁠⁠Tech Field Day⁠⁠⁠ for more information on upcoming and current event coverage ⁠⁠⁠on X/Twitter⁠⁠⁠, ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on LinkedIn⁠⁠⁠, or ⁠⁠⁠visit our website⁠⁠⁠.

...more
View all episodesView all episodes
Download on the App Store

Tech Field Day PodcastBy Tech Field Day

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

15 ratings


More shows like Tech Field Day Podcast

View all
The Cloudcast by Massive Studios

The Cloudcast

154 Listeners

The Everything Feed - All Packet Pushers Pods by Packet Pushers

The Everything Feed - All Packet Pushers Pods

194 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,043 Listeners

Network Break by Packet Pushers

Network Break

101 Listeners

Soft Skills Engineering by Jamison Dance and Dave Smith

Soft Skills Engineering

284 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

202 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

7,921 Listeners

Tech Field Day News Rundown by Tech Field Day

Tech Field Day News Rundown

3 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

183 Listeners

The Pomp Podcast by Anthony Pompliano

The Pomp Podcast

1,832 Listeners

The Journal. by The Wall Street Journal & Spotify Studios

The Journal.

5,958 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,200 Listeners

The Why Files: Operation Podcast by The Why Files: Operation Podcast

The Why Files: Operation Podcast

6,882 Listeners

The Economics of Everyday Things by Freakonomics Network & Zachary Crockett

The Economics of Everyday Things

1,613 Listeners

Packet Protector by Packet Pushers

Packet Protector

6 Listeners