The Data Science Podcast with Fexingo: Analytics, Machine Learning, and Data-Driven Conversations

How Data Scientists Use Vector Databases for RAG Systems


Listen Later

Retrieval-augmented generation, or RAG, is reshaping how companies deploy large language models without retraining. In this episode, Lucas and Luna drill into the data-science architecture behind RAG: how vector databases encode semantic meaning, why cosine similarity beats keyword search, and what a production RAG pipeline looks like at a mid-size fintech startup. They walk through a concrete example—building a customer-support bot for a payments company—showing where embedding models, chunking strategies, and approximate nearest-neighbor search come into play. Lucas breaks down the trade-off between accuracy and latency, and Luna questions whether RAG is just a band-aid for models that can't reason. Tune in for a grounded look at the database layer that's quietly powering the next wave of AI applications.

#VectorDatabases #RAG #RetrievalAugmentedGeneration #LLM #Embeddings #CosineSimilarity #ApproximateNearestNeighbor #DataScience #MachineLearning #NLP #AIArchitecture #CustomerSupport #Fintech #Pinecone #Weaviate #Milvus #FexingoBusiness #TechnologyPodcast

Keep every episode free: buymeacoffee.com/fexingo

...more
View all episodesView all episodes
Download on the App Store

The Data Science Podcast with Fexingo: Analytics, Machine Learning, and Data-Driven ConversationsBy Fexingo