Chapters

0:00 Bob the Podcast Host

1:20 Retrieval-Augmented Generation

4:10 Hallucination in LLMs

6:15 Solving Hallucination with RLHF

7:44 LLM Monster - Reasoning and Knowledge

10:12 Feedback Loops

11:00 Hands-on Code Demo

26:00 Demo Analysis from Bob and Connor

30:35 Star Wars Wes Anderson Generated Video

34:12 Multimodal Vector Databases

36:00 Speculative Design Theory

Links:

John Schulman - Reinforcement Learning from Human Feedback: Progress and Challenges: https://www.youtube.com/watch?v=hhiLw5Q_UFg

Colin Nesh (HaystackUS 2023 slide deck) - Ground is NOT all you need, Stop hallucinations & defects in generative search: https://docs.google.com/presentation/d/1uycLEUeRuF8A85Uso_A3OU6EF-qq4aYswWVxkPWHBKI/edit#slide=id.p

Generative Starwars video source - https://twitter.com/CuriousRefuge/status/1652412004626497536

Speculative Design Theory - https://readings.design/PDF/speculative-everything.pdf

Aggregation Theory - https://stratechery.com/aggregation-theory/