Sign up to save your podcasts
Or
Share Use Long Context or RAG?
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Use Long Context or RAG?
In this one, I discuss the dilemma between using retrieval-based generation and the newer "long context models".
Long context models, like the Gemini suite of models, allow us to send up to millions of tokens (thousands of text pages), whereas retrieval (RAG)-based systems allow us to search through as much (if not more) content and retrieve only the necessary bits to send the LLM for improved answers.
Both have advantages and disadvantages. This short episode will help you better understand when to use each.
Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29
Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29
Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29
View all episodes
By Louis-François Bouchard
4.2
55 ratings
In this one, I discuss the dilemma between using retrieval-based generation and the newer "long context models".
Long context models, like the Gemini suite of models, allow us to send up to millions of tokens (thousands of text pages), whereas retrieval (RAG)-based systems allow us to search through as much (if not more) content and retrieve only the necessary bits to send the LLM for improved answers.
Both have advantages and disadvantages. This short episode will help you better understand when to use each.
Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29
Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29
Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29
More shows like What's AI Podcast by Louis-François Bouchard
View all
All-In with Chamath, Jason, Sacks & Friedberg
9,207 Listeners