The Svagat Show

Expanding AI Infra beyond Nvidia | Nikhil Sonti - Felafax, Meta


Listen Later

Nikhil Sonti is the Co-founder of Felafax (YC S24), where they are building an open-source AI platform for non-NVIDIA GPUs. Prior to Felafax Nikhil was an engineer at Meta, Microsoft & Akamai working on distributed systems. He's building Felafax with his twin brother Nitin Sonti - who's done ML at Google/Youtube.

We discuss the ecosystem of non Nvidia GPUs like AWS Trainium and Google's TPUs and how they offer cost performance but need better developer tooling. We also discuss how this ecosystem can help unlock use-cases like using larger models for fine tuning smaller models, cost performance and Felafax's open source approach and more

...more
View all episodesView all episodes
Download on the App Store

The Svagat ShowBy Rishabh Kaul