AI can improve the mean quality of work on a team, but it makes accountability harder. Eric and John argue that it's not just about QA of the output, but who's doing the hard thinking before using AI.

AI can improve the mean quality of work on a team, but it makes accountability harder. Eric and John argue that it's not just about QA of the output, but who's doing the hard thinking before using AI.

Eric and John start with the "taste and judgment" framing that has dominated AI conversations in tech circles, then make the case for a third differentiator that almost no one is talking about: accountability. When AI raises the floor on everyone's work product, the real competitive edge shifts to who actually owns the output and who has the judgment to evaluate it.

They ground the conversation in fundamentals, tracing the lineage from Peter Drucker's management by objectives through OKRs, and examine what accountability looks like at a practical day-to-day level. From there, the episode gets specific: what happens when a mid-level employee suddenly shines with AI, or when a strong performer starts making more mistakes? John's answer cuts through the noise: AI rewards right thinking, not just fast doing.

The episode closes on two memorable examples. Eric describes an internal memo at Vercel called "Agent Responsibly," which drew clear lines of jurisdiction: if you push code to production, you own it, whether you wrote it or an agent did. And a new hire's insight about their content agent stops Eric cold: the tool is powerful, but it only works if people do the hardest part first, which is bringing a well-formed argument to the table.

Accountability is the undersold differentiator: Taste and judgment get all the attention in AI conversations, but ownership of output is the harder and more important factor, especially as AI raises the floor for everyone.

AI rewards right thinking: When mistakes increase after someone starts using AI, the diagnosis is almost always the same: not enough time invested in research and planning before building.

Drawing lines of jurisdiction is a leader's job now: "Agent Responsibly" frames it simply: if you push it to production, you own it. Leaders need to define those lines explicitly rather than letting them stay ambiguous.

Token budget allocation shapes output quality: Thinking of AI work as a pie chart of time spent across research, planning, prototyping, building, and QA reveals where most teams are underinvesting. Underspending on planning usually shows up as expensive QA.

Evals are accountability built into the machine: Defining what an AI agent should be able to do, writing test questions, and running them every time something changes is the structural equivalent of management by objectives for automated work.

AI erodes the skills required to use it well: L.M. Sacasas put it plainly: AI use tends to erode the formation of the virtue and expertise required to use it well. That makes deliberately practicing the hard, non-AI version of your work a form of self-preservation.

Don't shortcut the front end: The quality of what comes out of an AI agent is a direct function of how well-formed the input is. Building systems that help people do the hard upstream thinking, not just execute downstream, is the real unlock.

Peter Drucker is referenced as the father of modern management, whose methodology of management by objectives (MBOs) laid the groundwork for OKRs and the way most companies structure accountability today.

... (Read more at the episode page)