
Sign up to save your podcasts
Or


00:00–02:07
Introduction by Nicole; guests Dan Stanzione (Executive Director, TACC) and Don Schulte (VAST Data).
02:08–03:51
Reflections on TACC’s history, reputation for innovation, and pioneering adoption of new technologies.
03:52–05:57
Discussing dramatic shifts in HPC due to increased emphasis on power consumption, driven by the end of Dennard scaling.
05:58–08:37
Recent explosion of AI workload demands; increased costs and shortages (GPUs, skilled personnel, power infrastructure).
08:38–12:53
Speculation on future HPC developments: potential impacts of photonics, quantum computing, carbon-free energy sources, and changes in AI scaling strategies.
12:54–18:20
Dan emphasizes the importance of foundational HPC research historically done at national labs and universities, highlighting that current AI and infrastructure innovations rely heavily on these early HPC breakthroughs.
18:21–21:49
Introduction of Horizon, TACC’s upcoming NSF-funded supercomputer, replacing the Frontera system, focusing on scientific throughput, GPU optimization, and extensive solid-state storage.
21:50–27:57
Detailed discussion on the NSF’s Leadership Class Computing Facility (LCCF) award that supports Horizon, emphasizing scientific outcomes over raw computing power.
Horizon system designed specifically for real-time data assimilation, persistent interactive services, and complex scientific workflows, enabling significant improvements in science productivity.
27:58–30:36
Shift from batch-oriented computing to interactive, real-time workflows and persistent data management.
Importance of new data platforms (like VAST) providing consistent, high-performance data access across diverse computing tasks.
30:37–34:47
Stanzione emphasizes new data access patterns: smaller, random, constant I/O operations, challenging traditional HPC storage assumptions. Highlights VAST’s platform role in addressing these new storage needs effectively.
34:48–36:33
Closing remarks on the dramatic evolution in HPC data management over the past decade, noting fundamental shifts that were not anticipated even ten years ago.
00:00 – Introduction
Nicole introduces Jeff Denworth, reminiscing about the Big Data era (~2010–2014).
01:15 – Big Data to Big Metadata
Jeff reflects on the Big Data era (Hadoop, analytics, NoSQL).
Today's valuations (Snowflake, Databricks) suggest Big Data's continued relevance.
02:11 – The Rise of Big Metadata
Jeff describes the shift from Big Data to Big Metadata.
AI creates new categories and applications, rapidly driving data infrastructure demands.
Example: Nvidia’s rapid growth due to deep learning-driven workloads.
05:01 – Synthetic Data and Metadata Explosion
Jeff notes social networks using synthetic data to circumvent privacy regulations.
Metadata types include large-scale data catalogs to manage exabytes of data (e.g., OpenAI).
08:14 – Dynamic Data Catalogs
VAST Database as an example of transactional and analytical infrastructure.
Benefits of SQL queries replacing traditional file operations for faster data handling.
09:50 – Metadata Evolves with Vectors
Explanation of embeddings, vector databases, and similarity search.
AI-driven understanding of unstructured data via vectors.
11:56 – Massive Scale of Vector Databases
Rough estimate: ~40 trillion vectors per 100 petabytes of data.
Challenges with conventional vector databases at massive scale (cost, memory, speed).
13:22 – Future Scale Problems and AI-driven Data Engineering
Retrieval-Augmented Generation (RAG) increases vector database scale needs.
Nvidia's data flywheel concept accelerates embedding and data engineering automation.
15:48 – Predicting Infrastructure Needs (Two-Year Outlook)
Jeff predicts AI models will significantly improve data engineering within two years.
Enterprises need vector databases capable of transactional, real-time performance.
18:10 – Future-Proofing Infrastructure (Five-Year Outlook)
Jeff expects AI-driven automation to impact all business processes (factories, back-office).
Businesses must be prepared for rapid scaling and foundational AI-driven changes.
21:14 – Industries Leading the AI Infrastructure Race
AI adoption speed varies by industry—highest "fury" is in software development.
Banks and trading firms leverage AI differently: profit efficiency vs. alpha-seeking.
23:55 – Cloud vs. On-Premises Infrastructure Choices
Jeff sees hybrid approaches prevailing; decision-making depends on enterprise-specific needs.
Introduces idea of "agentic workforce" prompted by Jensen Huang's statement (100M AI agents).
24:31 – Agent Ownership and Future Consequences
Raises profound questions about ownership and management of AI agents in business.
Jeff notes limited current customer recognition of these deeper implications.
25:56 – Closing Remarks
Nicole and Jeff conclude by noting broad societal implications of AI-driven changes.
Emphasis on importance of continued discussions around big metadata.
Jonathan Koomey—renowned researcher and the mind behind Koomey’s Law—joins to explore how AI is testing the limits of power infrastructure and computing efficiency. We dig into the history of data center energy use, the real implications of synthetic data, and why renewables—not nuclear—may be the only scalable path forward. Koomey offers a candid look at the rebound effect, cost allocation in the grid, and why assuming infinite AI demand is a dangerous bet. If you care about the future of energy in the age of AI, this one’s for you.
This isn’t about faster servers or more storage; it’s about designing infrastructure for a new species of intelligent entities. In this episode, we explore how VAST Data is setting the stage for the AI-native cloud, where inference workloads take center stage, and agents form the nervous system of a new computational world.