AI Post Transformers

HBF: High Bandwidth Flash for AI Inferencing


Listen Later

These sources and patent discuss SanDisk's development of High Bandwidth Flash (HBF), a technology designed to address the significant memory and bandwidth demands of artificial intelligence models, particularly at the edge, such as on smartphones. The first article details a presentation by SanDisk's Alper Ilkbahar, who introduced HBF as a NAND-based memory solution that mimics High Bandwidth Memory (HBM) but offers significantly greater capacity at a similar cost, enabling massive AI models like GPT-4 to run on a single GPU or even allowing large mixture-of-experts models to function on a smartphone. The second article highlights a crucial development: SanDisk is collaborating with SK hynix, the market leader in HBM, to standardize the HBF specification, which is critical for creating a multi-supplier ecosystem and accelerating the commercial adoption of HBF for future AI workloads. Ultimately, both articles focus on HBF's potential to disrupt the memory industry by providing high-speed, high-capacity memory necessary for next-generation, memory-bound AI applications.Sources:https://patents.justia.com/patent/20250254893https://blocksandfiles.com/2025/02/25/sandisk-hbf/https://blocksandfiles.com/2025/08/07/sandisk-and-sk-hynix-working-to-standardize-high-bandwidth-flash/https://www.tomshardware.com/tech-industry/sandisk-and-sk-hynix-join-forces-to-standardize-high-bandwidth-flash-memory-a-nand-based-alternative-to-hbm-for-ai-gpus-move-could-enable-8-16x-higher-capacity-compared-to-dram
...more
View all episodesView all episodes
Download on the App Store

AI Post TransformersBy mcgrof