SemiAnalysis Weekly

Join Jordan Nanos, Doug O’Laughlin, and special guest Jeremie Eliahou Ontiveros for an in-depth analysis of the intersection between AI infrastructure and energy markets. Jeremie, Head of Datacenter & Energy Infrastructure Research, shares expert insights on how AI data centers are reshaping electricity pricing, market dynamics, and the regulatory challenges facing the grid today.

00:00 AI Data Centers and Electricity Prices

02:15 Market Dynamics: PJM vs. ERCOT

04:56 Supply and Demand Challenges

08:02 Thermal Accreditation and Market Reforms

11:05 Future of Energy Supply and Coal Retirements

17:13 The Future of Coal Power Plants

18:27 Balancing Energy Prices and Consumer Expectations

19:29 Customized Tariffs and Their Impact

20:28 Investment Commitments and Grid Reliability

22:30 Negotiation Timelines for Data Centers

24:32 Financing Mismatches in Energy Projects

25:10 The AI Boom and Its Impact on Energy

27:13 Anthropic vs. OpenAI: The Revenue Race

29:15 The Role of Government in AI Adoption

32:00 Demand Drivers in AI and Software Development

33:33 The Shift in Consumer Perception of AI

35:53 The Future of Coding and AI Integration

39:55 The Evolution of Software and AI Tools

43:53 The Canadian Tech Scene and AI Growth

Article (latest): https://newsletter.semianalysis.com/p...

00:00 Introduction to Vera Rubin and Extreme Co-Design

02:30 Innovations in GPU Architecture: From Blackwell to Rubin

05:38 Memory Bandwidth and HBM4: A New Era

08:26 NVLink 6 and Interconnect Enhancements

11:38 Cable-less Design: Revolutionizing System Assembly

14:29 Thermal Management Innovations in Rubin

17:30 Power Management and Performance Expectations

33:36 Innovations in Packaging and Heat Management

38:15 Chiller-less Design and Data Center Infrastructure

40:47 Power Delivery Innovations in Rubin

46:16 Memory Solutions and Supply Chain Management

54:57 Deployment Timeline and Future Expectations

InferenceX, formerly InferenceMAX: https://inferencex.com/

Article (latest): https://newsletter.semianalysis.com/p/inferencex-v2-nvidia-blackwell-vs

GitHub https://github.com/SemiAnalysisAI/InferenceX

Article (original) https://newsletter.semianalysis.com/p/inferencemax-open-source-inference

00:00 Introduction to InferenceX

02:52 Evolution from InferenceMAX to InferenceX

06:06 Benchmarking and Performance Insights

08:43 The Scale of Benchmarking Work

11:39 Collaboration with AMD and Nvidia

14:52 The Evolution of Inference Benchmarking

17:34 Optimizations and Their Impact

20:47 Challenges in Composability

23:51 Multi-Token Prediction Explained

26:52 Cost Implications of Optimizations

31:06 Understanding Inference Workloads and Benchmarks

33:44 Future Plans for Inference Optimization

37:16 Roadmap for New Models and Data Sets

39:03 Challenges in Benchmarking Multi-Turn and Multi-Modal Data

42:44 Experiences with AI Models and Their Limitations

48:43 Skepticism About Future AI Improvements

Claude Code Rising: https://semianalysis.com/institutional/claude-code-adoption-note/ and https://newsletter.semianalysis.com/p/claude-code-is-the-inflection-point

CPUs are back: https://newsletter.semianalysis.com/p/cpus-are-back-the-datacenter-cpu

Memory Mania: https://newsletter.semianalysis.com/p/memory-mania-how-a-once-in-four-decades

Claude Fast: https://x.com/SemiAnalysis_/status/2020922445989822709?s=20

Agent Swarms: https://x.com/SemiAnalysis_/status/2021283054019330194?s=20

Taiwan: https://x.com/SemiAnalysis_/status/2021222800707538980?s=20

Seedance2: https://x.com/kirkinator_sol/status/2012588116536631778?s=20 , https://docs.google.com/document/d/1du1Ld94b1d2TU4maYIcU-K6v405iWoYTILnO9ipsEXQ/edit?tab=t.0