AI Portfolio Podcast

Paige Bailey, a Lead Product Manager for Generative Models at Google DeepMind, shares her expertise in guiding teams training very large language models. She focuses on training code generation models, one of the industry's most valuable types of LLMs. Paige has held multiple leadership positions at Google, Microsoft, and Github. 

In this interview, you will understand the responsibilities of a top Product Manager at a forefront AI company and how you can navigate your career from a data position to a product manager position. 

📲 Paige Bailey Socials:
LinkedIn: https://www.linkedin.com/in/dynamicwebpaige/
Twitter: https://twitter.com/DynamicWebPaige
https://github.com/dynamicwebpaige

📲 Mark Moyou, PhD Socials:
LinkedIn: https://www.linkedin.com/in/markmoyou/
Twitter: https://twitter.com/MarkMoyou

See other interviews and talks from Paige:
- Generative Models: https://www.youtube.com/live/wqkKResXWB8?si=Vxwspw_TXGs9XoG9&t=2356
- Learning From Machine Learning - https://youtu.be/BNz2yFVppts?si=aA2hjphacfDP2taW
- Whats AI by Louis Bouchard - https://youtu.be/y5nxMnTtbD4?si=_eeADH9ZFAE-W6vy

📗 Chapters
00:00 Intro
02:19 Product Manager at Google DeepMind
04:12 Is LLM a fad?
06:35 Large VS Small LLM
08:37 Multimodal Model
11:06 Generative AI for Code Generation in Enterprise
14:25 Tokenization Approaches for Code Generation
20:30 Data Poisoning
23:31 Nervousness during Pre-Training Run
26:27 Best Practices for Fine-Tuning and Instruction Training
28:14 When to Redo a Training Run?
30:15 Obsession with Generative Models
34:18 Fine-Tuning Internal Codebase
36:40 Future of Software Engineers
39:30 LLM for Data Leaders
40:58 Gen AI for Small and Medium Enterprise
42:45 How do I Convince My Boss to Adopt Gen AI?
45:20 Evolution of Data Science
48:00 Gen AI for Investors
50:52 Workspace Shrinkage
53:06 Gen AI Impact on Academia
57:16 Advice for Web3 Influencers
01:01:52 Career Optimization Function
01:05:13 Switching to Product Management
01:07:05 Criteria for Changing the Job
01:10:06 Consuming AI Research Content
01:11:57 Top 1% Data Scientists
01:12:41 Imposter Syndrome
01:13:41 Unfair Advantage
01:17:00 Book Recommendations
01:20:11 Habits to Make Progress
01:21:40 Two Meals
01:23:00 Advice for High Schoolers, College Students, & Professionals
01:24:59 What do you want people to remember about you?

In this first episode you will learn why Hamza left Google as a Senior Research Manager to start a search startup given all the progress of large language models (LLM). He covers some core tenants you need to start building LLM-based systems. More importantly, in this fast-moving field, you learn how Hamza navigated his career and what you can do to make progress.  

Hamza Farooq is the CEO/founder of traversaal.ai. Previously, he was a Sr. Research Science Manager at Google, a lecturer at Stanford, and an adjunct professor at the University of Minnesota. Hamza has worked at top companies such as Walmart Labs and Gallup and teaches a course on Maven called Building LLMs Applications from Scratch into Production.

📲 Hamza Farooq Socials:
LinkedIn:   / hamzafarooq 

📲 Mark Moyou, PhD Socials:
LinkedIn:   / markmoyou  
Twitter:   / markmoyou  

Startup (Traversaal.ai) - https://www.traversaal.ai/

📒  Chapters 

00:00:00 Intro

00:03:01 - LLM Summer

00:04:06 - Falcon AI

00:07:27 - Language Modelling

00:08:33 - Distance Vs Metric Space Modeling

00:11:36 - Context Learning vs fine-tuning

00:14:38 - Benefit of larger LLM

00:17:41 - Lexical, Hybrid, or Neural Approach

00:21:41 - Natural preferences in LLM

00:24:52 - LLM in user reviews

00:27:34 - FOMO of AI

00:30:16 - AI Hype or Innovation

00:34:26 - Generative Models

00:35:40 - Open AI vs open-source models

00:38:36 - Open Source Models monetization

00:40:18 - Mistakes in LLM journey

00:41:53 - What is LLM

00:44:01 - LLM optimization

00:46:09 - NLP or LLM

00:47:35 - LLM consumption

00:49:04 - Models Hosting

00:51:17 - Education

00:53:33 - Open Source work

00:55:29 - ML system design

00:58:14 - Career

01:04:15 - Career Optimization function

01:08:24 - Advice for international students

01:11:06 - MBA and PhD

01:15:06 - Imposter Syndrome

01:16:44 - Perspectives for People in their home country

01:20:24 - Unfair Advantage