Tech on the Rocks

Optimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner


Listen Later

In this episode, we chat with Ben, founder of Espresso AI, about his journey from building Excel Python integrations to optimizing data warehouse compute costs. 

We explore his experience at companies like Uber and Google, where he worked on everything from distributed systems to ML and storage infrastructure. 

We learn about the evolution of his latest venture, which started as a C++ compiler optimization project and transformed into a system for optimizing Snowflake workloads using ML. 

Ben shares insights about applying LLMs to SQL optimization, the challenges of verified code transformation, and the importance of formal verification in ML systems. Finally, we discuss his practical approach to choosing ML models and the critical lesson he learned about talking to users before building products.

Chapters

00:00 Ben's Journey: From Startups to Big Tech
13:00 The Importance of Timing in Entrepreneurship
19:22 Consulting Insights: Learning from Clients
23:32 Transitioning to Big Tech: Experiences at Uber and Google
30:58 The Future of AI: End-to-End Systems and Data Utilization
35:53 Transitioning Between Domains: From ML to Distributed Systems
44:24 Espresso's Mission: Optimizing SQL with ML
51:26 The Future of Code Optimization and AI

Click here to view the episode transcript.

...more
View all episodesView all episodes
Download on the App Store

Tech on the RocksBy Kostas, Nitay

  • 5
  • 5
  • 5
  • 5
  • 5

5

5 ratings


More shows like Tech on the Rocks

View all
FoundMyFitness by Rhonda Patrick, Ph.D.

FoundMyFitness

5,272 Listeners

Techmeme Ride Home by Brian McCullough

Techmeme Ride Home

943 Listeners

Practical AI by Practical AI LLC

Practical AI

190 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

8,773 Listeners