The Circuit

In this episode of The Circuit, Ben Bajarin and Jay Goldberg discuss the launch of Ben's new publication, "The Diligent Stack." The duo then performs a deep dive into TSMC’s recent earnings, analyzing the risks of semiconductor cyclicality, the massive CapEx requirements for the future, and the specific bottlenecks in advanced packaging (CoWoS). Later, they shift focus to OpenAI’s partnership with Cerebras and the introduction of ads to fund massive compute needs. Finally, they break down the latest data on GPU pricing, highlighting the significant premiums hyperscalers charge compared to NeoClouds and the difficulty of tracking pricing for Nvidia's new Grace Blackwell chips.

In this episode, Ben Bajarin and Jay Goldberg discuss the highlights from CES 2023, focusing on the significant advancements in robotics, AI infrastructure, and the competitive landscape among major tech companies like NVIDIA, AMD, and Intel. They explore the themes of modularity in data centers, the evolving role of CPUs, and the challenges posed by memory supply constraints. The conversation also touches on the future of autonomous vehicles and the integration of AI in everyday technology, emphasizing the rapid pace of innovation in the tech industry.

In this conversation, Ben Bajarin and Jay Goldberg engage with Benedict Evans to explore the current state of AI development, its historical context, and future predictions. They discuss the potential for an AI bubble, the importance of productization for user adoption, and the varying levels of AI integration across different industries. The conversation also touches on the comparison between Nvidia and Sun Microsystems, highlighting the challenges and opportunities in the AI landscape.

In this episode, Ben Bajarin, Jay Goldberg, and Austin Lyons delve into the evolving landscape of networking, particularly in the context of AI and GPU technologies. They discuss the transition from traditional networking methods to more complex AI-driven networking, the significance of scaling strategies, and the critical role of SerDes in modern data centers. The conversation also touches on the ongoing debate between copper and optical networking solutions, highlighting the challenges and innovations in the field.

This discussion analyzes the evolving landscape of semiconductor networking and custom silicon, anchored by recent updates from Marvell and Broadcom. Ben and Jay review Marvell’s Industry Analyst Day, noting the company’s strategic pivot toward networking and optical interconnects over pure custom logic. They debate the technical and timeline challenges of shifting AI clusters from copper to optical (fiber) cabling, contrasting Google’s proprietary all-optical approach with the broader merchant market. The conversation then moves to Broadcom’s recent earnings, dissecting the market’s negative reaction to CEO Hawk Tan’s low-energy performance, the looming competitive threat of MediaTek at Google, and the complexities of modeling AI revenue. Finally, they close with a year-end review of AI stock performance, highlighting growing capital sensitivity and skepticism regarding the sustainability of current AI infrastructure spending.

In this episode, Ben and Jay discuss a range of topics including Ben's health update, Amazon's recent AWS event focusing on AI compute, the competitive landscape with Nvidia and Google, Marvell's earnings and challenges in custom silicon, networking innovations with DPUs, Marvell's acquisition of Celestial, Nvidia's investment in Synopsys, Intel's resurgence in advanced packaging, and the leadership changes at Apple. The conversation highlights the evolving dynamics in the tech industry, particularly in AI and cloud computing.

In this conversation, Ben Bajarin discusses the recent innovations surrounding NanoBanana and its new feature, Notebook LM, which has significantly impacted the way infographics are created. He highlights the ease with which users can transform data and text into visually appealing infographics, showcasing the power of AI in data visualization.

The conversation explores the dynamics of market competition, particularly focusing on AMD's position and the strategies of hyperscalers. The discussion delves into game theory as a framework for understanding potential future scenarios in the tech industry. They also discuss key neocloud earnings and engage in a conversation on if these companies are REITs or neoclouds. 

This episode argues that today’s AI exuberance fits a familiar pattern: bubbles misallocate capital on the way up but leave behind productive infrastructure that powers the next S-curve. We revisit the “boom-bust-build-out” cycle and apply it to compute and the grid, note why “good enough” AI latency could flip capex behavior, and push back on modeling everything in gigawatts—useful for planning, risky for strategy. On companies: ARM’s quarter was solid, with rising royalties/CSS stickiness and a strongly implied first-party chip effort complemented by the DreamBig memory-controller acquisition to improve AI-era CPU roles. Qualcomm benefits from a higher-ASP Android cycle, nurtures auto/smart-glasses adjacencies, and eyes DC inference. On supply: Elon hedges silicon with foundry allocations while fab-building talk reads as negotiating leverage; memory/storage stay tight with longer contracts and measured adds. Net: optimism about what survives the eventual correction, caution on GW-only thinking, and watchpoints around ARM’s vertical creep, Qualcomm’s DC push, and supply-chain discipline.

The conversation delves into the competitive landscape of cloud computing, focusing on Nvidia's ambitions and the fragmentation of the market with numerous Neo clouds. Jay Goldberg discusses the implications of this fragmentation for Nvidia and its customers, who are increasingly seeking to develop their own custom silicon.