The Geek In Review

RAG is Not Dead: Josef's Sam Flynn on Legal Tech That Works


Listen Later

This week, we sit down with Sam Flynn, COO and co-founder of Josef, to separate substance from hype in the rapidly evolving world of legal tech. Sam shares his passionate stance that “RAG is not dead,” defending Retrieval-Augmented Generation (RAG) as a foundational and still deeply relevant method for deploying AI in the legal industry—despite the flashy allure of agentic AI. His nuanced take reminds listeners that success in this space depends not only on the sophistication of the technology, but on doing the “boring” foundational work: ensuring data integrity, context-aware chunking, and responsible workflows.

Throughout the discussion, Sam champions the idea that great legal technology should not just enhance expert workflows but make legal information accessible to non-experts. With examples from Josef’s clients like L’Oréal, Bumble, and Bupa, Sam illustrates how Josef’s tools allow legal departments to offload routine work through reliable self-service systems—freeing up time for more strategic thinking while improving speed, compliance, and consistency across organizations. He makes the case that empowering end users with trustworthy tools isn’t just good tech—it’s a new model for scaling legal and compliance services.

A key highlight is Josef’s Roxanne project, developed in collaboration with Housing Court Answers and NYU. Roxanne is an AI-powered tool designed to help tenants in New York navigate the complexities of housing law. Sam outlines the safeguards that ensure Roxanne’s answers are accurate and compliant, such as closed-domain data sources, human-in-the-loop validation, and smart escalation workflows. The conversation touches on the broader access to justice (A2J) implications of this technology—arguing that when designed carefully, AI can amplify the reach and impact of legal aid organizations by orders of magnitude.

The episode doesn’t shy away from the tensions legal professionals feel when automation enters their domain. Sam offers a powerful reframing: instead of seeing these tools as a threat, lawyers should view them as opportunities to offload low-value tasks and expand their influence. The goal, he says, is not to cut jobs—but to redefine the kind of work legal professionals do, making space for more proactive, strategic, and meaningful engagements within organizations and communities.

As the conversation wraps, Sam shares his optimism about the future—tempered by a clear-eyed understanding of the human factors that will determine success. While the technology is ready, the question is whether legal professionals will step up and take the lead. His call to action is clear: focus less on the hype, and more on the systems, safety, and trust that make tech transformative. Whether you're a legal technologist, innovator, or cautious observer, this episode offers a grounded and inspiring look at what it takes to build legal tech that actually works.

Listen on mobile platforms:  ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Apple Podcasts⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ |  ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Spotify⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠YouTube⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

Special Thanks to ⁠Legal Technology Hub⁠ for their sponsoring this episode. 

Blue Sky: ⁠⁠@geeklawblog.com⁠⁠ ⁠⁠@marlgeb⁠⁠
⁠⁠⁠⁠⁠Email: [email protected]
Music: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Jerry David DeCicca⁠⁠⁠⁠⁠⁠⁠⁠⁠

Transcript

...more
View all episodesView all episodes
Download on the App Store

The Geek In ReviewBy Greg Lambert & Marlene Gebauer

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

26 ratings


More shows like The Geek In Review

View all
Planet Money by NPR

Planet Money

30,698 Listeners

Pivot by New York Magazine

Pivot

9,594 Listeners

HBR IdeaCast by Harvard Business Review

HBR IdeaCast

1,837 Listeners

The Daily by The New York Times

The Daily

112,501 Listeners

Up First from NPR by NPR

Up First from NPR

56,536 Listeners

Technically Legal - A Legal Technology and Innovation Podcast by Percipient - Chad Main

Technically Legal - A Legal Technology and Innovation Podcast

25 Listeners

LawNext by Populus Radio, Robert Ambrogi

LawNext

36 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,576 Listeners

Hard Fork by The New York Times

Hard Fork

5,528 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,984 Listeners

The AI Daily Brief: Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief: Artificial Intelligence News and Analysis

607 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,411 Listeners

Legal Innovation Spotlight by Infodash

Legal Innovation Spotlight

9 Listeners

Zach Abramowitz is Legally Disrupted by Zach Abramowitz

Zach Abramowitz is Legally Disrupted

4 Listeners

Further Comments by Damien Riehl & Horace Wu

Further Comments

0 Listeners