The Circuit

With Special guests, Austin Lyons and Paul Karazuba! 

The conversation covers the topic of NPUs (Neural Processing Units) and delves into their architecture, performance, and relevance in the semiconductor industry. The discussion also addresses the use of tops per watt as a metric for NPU performance and the design origins of NPUs, including the use of licensed IP and the evolution from DSPs to NPUs. The conversation delves into the topic of NPUs (Neural Processing Units) and their integration into various devices. The speakers discuss the origins of NPUs, their design philosophy, and the potential impact on consumer devices. They also explore the role of NPUs in edge devices, AI PCs, and the future of consumer use cases for AI. The conversation concludes with predictions about the widespread adoption of NPUs and their potential impact on the market.

In this episode, Ben Bajarin and Jay Goldberg discuss the recent Google I/O event and the introduction of new TPUs and CPUs. They also explore the ARM architecture in the data center and the potential for switching between different ARM CPUs. Additionally, they touch on Qualcomm's launch of Windows on ARM and the significant adoption of Qualcomm SKUs by major OEMs. The conversation covers various topics including the dynamics in the PC space, Nvidia's earnings, and the 10-to-1 stock split. The main takeaways include the strong position of Windows in the PC ecosystem, the growth of Nvidia's data center networking business, and the potential impact of a dedicated inference chip. The conversation also discusses the competition in different parts of Nvidia's stack and the volatility that may come with the stock split.

In this episode of The Circuit, Ben Bajarin interviews Esam Elashmawi, Chief Strategy and Marketing Officer of Lattice, about the world of Field-Programmable Gate Arrays (FPGAs). They discuss the basics of FPGAs, their unique capabilities, and their pervasiveness across various applications. They also explore the advantages of FPGAs over Application-Specific Integrated Circuits (ASICs) and the flexibility they offer in terms of customization and reprogramming. Esam highlights the role of FPGAs in different markets, such as communications, computing, industrial, and automotive, and how Lattice differentiates itself in the FPGA market. They also touch on the challenges of building an FPGA company and the potential of FPGAs in AI applications, both in data centers and at the edge.

In this episode of The Circuit, Ben Bajarin and Jay Goldberg interview Aart de Geus, the executive chair and co-founder of Synopsys, about the semiconductor industry and the evolution of electronic design automation (EDA). They discuss the concept of EDA and how it allows designers to simulate and optimize circuits without physically building them. Aart de Geus highlights the shift from analog to digital design as a major inflection point in the industry. He also explains the role of EDA tools in automating the design process and the importance of functional correctness in chip design. The conversation then delves into the future of chip design, including the use of AI in EDA tools, the rise of chiplets and vertical stacking, and the increasing complexity of system-level design.

In this episode of The Circuit, Ben Bajarin and Jay Goldberg discuss the latest developments in the semiconductor industry, focusing on the sectors of data centers, PCs, mobile, automotive, and industrial semiconductors. They analyze the performance of companies like Intel, AMD, Nvidia, Apple, Qualcomm, and NXP, and explore the factors influencing their success or challenges. The conversation highlights the impact of AI on the industry, the dynamics of the Chinese market, the potential for a super cycle in PCs, and the outlook for the automotive and industrial semiconductor sectors.

Summary

In this episode, Ben Bajarin and Jay Goldberg discuss the skyrocketing capex by cloud hyper scalers and its implications. They explore the significant growth in capex spending by companies like Google, Microsoft, and Amazon, and the connection between capex and revenue growth. They also discuss the challenges of monetizing AI investments and the need for clear consumer use cases. The conversation touches on the potential for new innovations in AI wearables, AR glasses, autonomous cars, and robotics. They also consider the deflationary effects on costs and the timeline for the development of AI applications.

Episode Summary

The recent downturn in semiconductor and AI-related stocks has sparked concerns about a bubble. The volatility in these stocks can be attributed to the unpredictability of retail investors and traders. The market is experiencing a correction, but it does not indicate a slowdown in AI. The hype around AI has been tempered by the realization that progress is slower than expected. The energy constraint is a topic of discussion, but improvements in hardware and software will continue to address this issue. The future of AI depends on the balance between compute power and energy efficiency.

This episode of The Circuit discusses the recent trend of companies developing their own custom CPUs and accelerators for AI workloads. Google, Amazon, and Microsoft have all announced their own custom chips, while Facebook and Marvell are also entering the custom chip market. The conversation also touches on the challenges and trade-offs of custom silicon, the impact on NVIDIA, and the difficulty of accurately sizing the AI market. The hosts highlight the uncertainty surrounding the future of AI outsourcing and the potential shift in the fortunes of the semiconductor and cloud industries.

Summary

In this conversation, Ben Bajarin and Jay Goldberg discuss the recent Intel webinar on the foundry business and the financial breakout for Intel Foundry Services (IFS). They analyze the financial details, including the higher costs and lower margins than expected, and the potential for improvement in the future. They also discuss the impact of the CHIPS Act and the subsidies received by TSMC for their Arizona foundries. The conversation concludes with a discussion on Intel's progress under CEO Pat Gelsinger and the opportunities and challenges they face in the data center and AI markets.

In this episode, Ben Bajarin and Jay Goldberg discuss the competition faced by Nvidia in the semiconductor industry. They explore various competitors, including AMD, Intel, and startups like Grok, Etched, and Cerebras. They also delve into the threat posed by custom silicon and the strategies of hyperscalers like Google, Microsoft, Facebook, and Amazon. Overall, the conversation highlights the challenges and opportunities for Nvidia in maintaining its position as a leader in the market. In this conversation, Jay Goldberg and Ben Bajarin discuss various themes related to Nvidia and the AI market. They explore the growing moat of Nvidia and the dominance of CUDA as a software platform. They also discuss the ease of use and stickiness of CUDA, as well as the uncertainty of Nvidia's software adoption. The conversation delves into the market potential and consumer applications of AI, as well as the slow progression of the AI market. They also touch on the risks of AI factories and inventory cycles, the potential slowdown of performance gains, and the regulatory concerns for Nvidia. The conversation concludes with a discussion on the impact of China's market and US sanctions.