Cables2Clouds

What Does an AI Data Center Look Like? - C2C046


Listen Later

Send us a text

World-renowned network expert Peter Jones returns to the Cables to Clouds podcast, sharing his unparalleled insights into the electrifying evolution of AI networking. We promise listeners a captivating journey through the latest advancements and investments reshaping data centers to meet the high demands of AI. Explore with us the nuanced differences between AI for networking and networking for AI, as we shed light on how these developments are capturing Wall Street’s attention and web scalers’ ambitions.

Venture into the intricate world of networking technology as we tackle the tough challenges of packet reliability and error management, pondering whether the link layer should shoulder more of TCP's load. Discover the strategies of tech behemoths like Google, Meta, and Microsoft as they navigate the complex terrain of cost, power, and reliability. From innovative solutions like liquid cooling and disaggregated power to the futuristic promise of nuclear energy, we'll dive deep into the technological shifts required to power tomorrow's networks.

Finally, Peter lends his expertise to unravel the scaling challenges of GPU networks, especially poignant in the realms of Bitcoin mining and cloud computing. Listen as we draw parallels between overclocking and the immense strain on GPUs in mining farms, all while questioning the sustainability of these massive endeavors. As we explore Microsoft's strategic energy maneuvers and the potential of disaggregated systems, this episode promises a comprehensive look at the future of data centers and the efficient management of AI workloads. Join us for an enlightening conversation that paves the way for understanding the dynamic future of networking.

Links:
https://www.semianalysis.com/

Google
https://cloud.google.com/blog/topics/systems/the-evolution-of-googles-jupiter-data-center-network

Meta
https://engineering.fb.com/2024/08/05/data-center-engineering/roce-network-distributed-ai-training-at-scale/
https://engineering.fb.com/2023/11/15/networking-traffic/watch-metas-engineers-on-building-network-infrastructure-for-ai/

Microsoft

Purchase Chris and Tim's new book on AWS Cloud Networking: https://www.amazon.com/Certified-Advanced-Networking-Certification-certification/dp/1835080839/

Check out the Fortnightly Cloud Networking News
https://docs.google.com/document/d/1fkBWCGwXDUX9OfZ9_MvSVup8tJJzJeqrauaE6VPT2b0/

Visit our website and subscribe: https://www.cables2clouds.com/
Follow us on BlueSky: https://bsky.app/profile/cables2clouds.com
Follow us on YouTube: https://www.youtube.com/@cables2clouds/
Follow us on TikTok: https://www.tiktok.com/@cables2clouds
Merch Store: https://store.cables2clouds.com/
Join the Discord Study group: https://artofneteng.com/iaatj

...more
View all episodesView all episodes
Download on the App Store

Cables2CloudsBy Cables2Clouds

  • 5
  • 5
  • 5
  • 5
  • 5

5

11 ratings


More shows like Cables2Clouds

View all
Security Now (Audio) by TWiT

Security Now (Audio)

1,983 Listeners

StarTalk Radio by Neil deGrasse Tyson

StarTalk Radio

14,157 Listeners

The Cloudcast by Massive Studios

The Cloudcast

152 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners

Hacked by Hacked

Hacked

183 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

202 Listeners

Darknet Diaries by Jack Rhysider

Darknet Diaries

7,909 Listeners

Defense in Depth by David Spark, Steve Zalewski, Geoff Belknap

Defense in Depth

74 Listeners

The Hedge by Russ White

The Hedge

15 Listeners

The Art of Network Engineering by Andy and friends

The Art of Network Engineering

82 Listeners

Cyber Security Headlines by CISO Series

Cyber Security Headlines

127 Listeners

Hacker And The Fed by Chris Tarbell & Hector Monsegur

Hacker And The Fed

167 Listeners

The Cloud Gambit by William Collins

The Cloud Gambit

7 Listeners

Network Automation Nerds by Packet Pushers

Network Automation Nerds

3 Listeners

Total Network Operations by Packet Pushers

Total Network Operations

3 Listeners