Every AI tool claims it can read your folders. We actually tested that claim — across ChatGPT, Claude, Gemini, and Microsoft Copilot — using a real-world 48-document Chapter 13 case file. The results were all over the place.

Ron introduces the "File Cabinet Test": a threshold check that tells you whether an AI tool is actually seeing what you're giving it, before you trust it with anything that matters. Because if the AI is faking it — cherry-picking by relevance, wandering outside your folder, or missing documents entirely — that's not an AI intelligence problem. That's a visibility problem. And for lawyers, visibility is everything.

This episode is a deep dive into folder access, document security, workflow design, and what it really means to close the trust gap in your practice.

What You'll Learn

• What the File Cabinet Test is and why it's the first question you should ask of any AI tool
• How ChatGPT, Claude, Gemini, and Copilot each performed on real legal documents — and where each one surprised us
• Why "the AI comes to you" is a game-changer for law firm document security
• The hidden risk when AI output looks complete but isn't
• How a bankruptcy trustee's preference complaint workflow points to the next frontier of AI-assisted legal practice
• What Claude's new MCP integration with NetDocuments means for Jetsons-level lawyers — right now

Chapter Markers

• 0:00 — Introduction: Testing AI folder access across four platforms
• 1:05 — The test case: A complex Chapter 13 with 48 documents
• 2:00 — Introducing the File Cabinet Test (and why AI wants to fake it)
• 3:47 — Heather's ChatGPT zip file test: A home run — and a teaching moment
• 5:54 — Visibility vs. intelligence: The real question we're asking
• 7:30 — The million-document file: A tease for the roadmap
• 8:58 — ChatGPT connected to Google Drive: Same tool, different result
• 10:42 — Claude: Security, redaction, and a perfect file cabinet test
• 13:34 — Claude's limitations: Budget gaps and the timeout problem
• 15:00 — Analysis vs. ecosystem tools: How to frame the choice
• 15:59 — Gemini inside Google Drive: Close, but not quite
• 18:27 — The trust gap: Why small firm lawyers can't do what we just did
• 19:41 — Copilot: Why Ron wanted it to work, and what happened instead
• 22:19 — The Copilot saga escalates: Zip files, crashes, and a 20-file ceiling
• 25:57 — Where Copilot actually belongs in your workflow
• 27:30 — Workflow-first, tools-second: How to find your bottleneck
• 28:49 — AI malpractice on the horizon: The human oversight imperative
• 31:50 — Practice Signal: Preference complaints and the AI merge-print breakthrough
• 36:13 — FSJ Level-Up: Flintstones, Simpsons, and Jetsons recommendations
• 38:49 — Jetsons surprise: Claude + NetDocuments MCP integration, live today
• 40:34 — Ron's take: Why he resisted Claude — and why he changed his mind
• 41:35 — Closing thoughts: Making lawyers less afraid

Resources & Links

• lawyeraitoolkit.com
• ChatGPT Enterprise — openai.com
• Claude — claude.ai
• Google Gemini — gemini.google.com
• Microsoft Copilot — copilot.microsoft.com
• NetDocuments — netdocuments.com