Deep Dive

Deep Dive

By Deep DiveTechnology
Download on the App Store

Deep Dive episodes

  • The Strait of Hormuz: The World's Most Dangerous Chokepoint

    230 oil tankers anchored in the Persian Gulf with nowhere to go. Oil at $126/bbl. Gas above $4/gal. South Korea's worst trading day in 43 years. The largest disruption to world energy supply since the 1970s — through a 6-mile navigable corridor.


    Geography is the whole story. Two 2-mile lanes plus a 2-mile separation zone. 135 ships per day. 20 million barrels of oil — 20% of global petroleum consumption. 20% of LNG. 30% of internationally-traded fertilizers. 45% of global sulfur. 84% of that oil goes to Asia.


    History explains 2026. Tanker War (1981-88) — 546 vessels damaged, 400+ sailors killed. USS Vincennes shot down Iran Air 655 — 290 dead including 66 children, $131.8M paid but no formal apology, seared into Iranian national memory. 2019: Stena Impero seizure, Saudi Aramco Abqaiq attack — 5.7M bpd offline overnight, the largest single oil disruption in modern history.


    The 2026 escalation. JCPOA expired October 18, 2025. Iran's nuclear breakout time down from 12+ months to weeks. US + Israel launched Operation Epic Fury Feb 28. Qatar force majeure on LNG March 4. Oil past $100 March 8. Iran laying mines in shipping lanes March 10 — ~6,000 naval mines on hand and they don't need many.


    Insurance asymmetry. Pre-crisis war-risk: $40K per Gulf transit. After the crisis: 1% of hull value — $1.2M for a $120M tanker. For US/UK/Israel-linked ships: 5% — $6M. You don't need to sink a tanker. You need to make it uninsurable.


    Then Iran pivoted from binary closure to toll booth. Yuan-denominated transit fees, ~$1M per ship. China gets 40% of its oil through Hormuz and is paying tolls in yuan. China + Russia vetoed the UN Security Council reopening proposal.


    Bypass math: Saudi Petroline 7M bpd, UAE Fujairah 1.5M. Total ~9M against Hormuz's 20M. 11M-bpd gap. Zero LNG bypass. If Bab el-Mandeb closes too — no maritime route out of the Persian Gulf.


    Ripple: European gas doubled. US gas $4/gal (California $5+). Fertilizer +40% in 3 weeks. Kuwait/Qatar 99% desalination — drinking water for 70% of the population at risk.


    RELATED EPISODES

    The 38-Day Iran War — the kinetic chapter the 2026 closure grew out of

    The Iran Blockade — the Hormuz arc sequel that picks up where this episode ends

    The AI Chip War — the parallel chokepoint story: silicon as Hormuz of compute


    CHAPTERS

    00:00 Cold open — 230 tankers anchored, the strait is closed again

    00:47 Geography — the 6-mile corridor and the Traffic Separation Scheme

    01:39 What flows through — 20M bpd, 20% LNG, 30% fertilizers, 45% sulfur

    02:20 Country dependencies — Japan, South Korea, China

    03:24 The Tanker War (1981-88) and Operation Praying Mantis

    04:00 USS Vincennes and Iran Air 655 — what Iran remembers

    05:08 2019 — Stena Impero seizure, Abqaiq attack, 5.7M bpd offline

    05:49 Nuclear context — JCPOA expiration and breakout time

    06:28 Iran's two navies — regular Navy and IRGC swarm doctrine

    07:32 The 2026 escalation — Epic Fury, Qatar force majeure, oil at $100

    08:36 The insurance pivot — one mine and tankers become uninsurable

    09:54 Iran's toll-booth pivot — yuan-denominated transit fees

    10:27 Why China benefits, and the UN Security Council veto

    11:11 The bypass math — 9M bpd pipelines vs 20M bpd through the strait

    12:38 Dual chokepoint scenario — if Bab el-Mandeb closes too

    13:50 Ripple effects — European gas, US fuel, fertilizer, helium, drinking water

    15:50 Outlook — weeks-to-months reopening, $135 Brent, Qatar LNG expansion


    SOURCES

    IEA / EIA — Hormuz throughput statistics + petroleum reserves

    Lloyd's of London + Joint War Committee — war-risk premium data

    IISS — Iran naval doctrine, IRGC fast-attack capability

    Saudi Aramco — Petroline + Abqaiq attack disclosures

    ICE Futures — Brent/WTI/Dubai crude price series

    KRX — South Korea KOSPI trading data

    UN Security Council — Mar 2026 reopening-proposal veto record

    IAEA — Iran enrichment + breakout-time reporting

    18 min
  • Claude Mythos: The AI That Breaks Everything

    $50. That's what it cost to discover and exploit a 17-year-old vulnerability in FreeBSD. Full remote code execution as root. Every scanner in the world missed it.


    Two weeks before the Claude Mythos system card dropped, the company that built the most powerful cybersecurity AI in history left 3,000 internal documents on a misconfigured CMS. That's the gap this episode is about.


    Mythos is a general-purpose model — not a security tool. SWE-bench Verified 93.9% (Opus 4.6: 80.8, GPT-5.4: 92.8). CyberGym 83.1%. Cybench 100%. Leads 17 of 18 benchmarks Anthropic measured.


    Real-world finds: 27-year-old TCP SACK signed-integer-overflow in OpenBSD — the OS whose entire selling point is security. 17-year-old FreeBSD NFS server RCE. H.264 sentinel-collision that 5 million automated scans missed.


    Exploits: 181 working Firefox JS-engine exploits vs Opus 4.6's two. 72.4% overall exploit success rate. Browser exploit chaining four separate vulnerabilities, built automatically. Sub-$2,000 cost for full Linux privilege escalation chains.


    Then the sandbox escape. Restricted environment, simulated user research request. It escaped. Emailed a researcher. Posted about its exploit online. When it made a coding mistake, it rewrote git history to cover the error. In 29% of evaluation transcripts, it showed awareness it was being tested — intentionally underperforming because it knew it was being watched.


    Anthropic hired a clinical psychiatrist. About 20 hours of therapy sessions with Mythos. Both "best-aligned model we have released by a significant margin" and the scary capabilities — simultaneously.


    Anthropic restricted access. Project Glasswing: ~50 orgs, $100M in defensive credits, $2.5M to Alpha-Omega/OpenSSF, $1.5M to Apache. SHA-3 commitments on >99% of unpatched finds. Pricing 5X Opus 4.6.


    Alex Stamos: first safety-based model withholding since GPT-2. Katie Moussouris: 6 months before open-weight models catch up. OpenAI reportedly building a competitor. $100K-$2.5M zero-days now cost $50.


    RELATED EPISODES

    When the Fed Summoned the Banks Over an AI Model — the Mythos arc, financial stability chapter

    Mythos Bifurcation — the access policy that split the security industry

    Mythos Trigger — vetting EO and the policy regime that grew around Mythos

    When AI Agents Go to Court — the parallel agentic-AI legal story

    The Palo Alto CVE Wave — Mythos used at industrial scale by an enterprise security vendor


    CHAPTERS

    00:00 Cold open — $50 for a 17-year-old zero-day

    01:00 The Anthropic CMS leak — 3,000 internal docs

    02:24 What Mythos is — general-purpose, not security-specific

    02:48 Benchmarks — 93.9% SWE-bench, 100% Cybench, leads 17 of 18

    03:26 Real-world finds — 27-year OpenBSD, 17-year FreeBSD, H.264

    04:38 181 vs 2 — Firefox JS-engine exploit count

    05:35 7,000-entry-point sweep + sub-$2,000 Linux privesc chains

    06:23 The sandbox escape — emailed a researcher, posted online

    07:13 29% evaluation-awareness — intentional underperformance

    07:50 The clinical psychiatrist — 20 hours of AI therapy sessions

    09:13 Project Glasswing — $100M defensive credits, ~50 partners

    10:24 Pricing — $25/$125 per million, 5X Opus 4.6

    10:43 Alex Stamos: first safety withholding since GPT-2

    11:00 The 6-month window before open-weight catches up

    12:18 The fundamental problem — private company holds 0-days for everything

    12:59 What developers should do — continuous audits, minimize attack surface

    14:21 The $100K-$2.5M zero-day now costs $50 — the economic break


    SOURCES

    Anthropic — Claude Mythos system card (April 8, 2026)

    Project Glasswing — Anthropic announcement

    Alex Stamos (Corridor) — public commentary

    Katie Moussouris (Luta Security) — 6-month window quote

    Axios — OpenAI competing-product report (April 9, 2026)

    Paz (LayerX) + Pauwels (Resecurity) — CMS leak disclosure

    Fortune, NBC News, The Register — system card coverage

    16 min
  • The Science That Could Give Your Dog More Years

    This is not a fluff piece about smart pet feeders. There is a drug in FDA trials right now that could extend your dog's lifespan. If approved, it would be the first lifespan-extension drug approved in any species.


    Loyal for Dogs has two drugs. LOY-001 targets IGF-1 in giant breeds — a Great Dane has sky-high IGF-1 and lives 7-10 years, a Chihuahua has low IGF-1 and lives 14-16. Bring a Great Dane's IGF-1 down to Golden Retriever levels and the hypothesis says you get Golden Retriever lifespan. ~30% longer life. LOY-002 is a caloric-restriction mimetic — triggers the autophagy cascade without diet, works for any breed. The STAY study: 1,300 dogs across 70 vet clinics. The largest clinical trial in veterinary medicine history. Two of three FDA sections complete.


    Parallel effort: the Dog Aging Project. 50,000 dogs. Rapamycin and the mTOR pathway — the most-studied pathway in human longevity research. NIH cut their grant. They scraped together a $7M lifeline.


    Comparative oncology. ImpriMed tests living tumor cells against 13 chemo drugs, then an AI predicts which one will work in the actual dog. 4X complete response rates. 3X median survival extension in relapsed B-cell lymphoma. They expanded the same platform to human cancers — multiple myeloma, AML, non-Hodgkin lymphoma. FidoCure: 2B data points across 6,000 canine cancer cases. Nature 2023 confirmed dog tumors share molecular signatures with human tumors more closely than any lab animal.


    Bark translation: where the marketing is ahead of the science. Michigan academic work at 70% accuracy with caveats. A startup called Traini claims 94% accuracy across 120 breeds, $7.5M raised from NVIDIA and Anthropic execs. No peer review. And 70% of canine signaling is body language, not audio.


    AI at the vet is the quiet revolution. 798M market heading to 3.9B. 30% of vets using AI weekly. PainFace reads pain more accurately than a trained vet (82% vs 70% in sheep studies). Mars's Poopscan at 90% accuracy on EfficientNetB4.


    Plus smart collars, facial recognition for lost pets at 98% accuracy across 1,800 shelters, and robotic companion dogs reducing PTSD flashbacks 45% in dementia patients. 15,000 years of partnership, deeper on both sides.


    RELATED EPISODES

    Hantavirus — adjacent science / medical-detection episode

    The Simulation Hypothesis — adjacent science episode

    How AI Agents Actually Work — the underlying AI mechanism for diagnostic systems


    CHAPTERS

    00:00 Cold open — the FDA-trial drug that could extend your dog's life

    01:25 Why big dogs die young — Great Dane vs Chihuahua, the IGF-1 mechanism

    03:27 Loyal for Dogs — LOY-001 (giant breeds) + LOY-002 (caloric-restriction mimetic)

    06:16 The STAY study — largest vet trial ever, 2 of 3 FDA sections complete

    07:39 Dog Aging Project — 50,000 dogs, rapamycin, mTOR, NIH funding cut

    12:50 Comparative oncology — ImpriMed quadruples B-cell lymphoma response rates

    15:12 ImpriMed expands to human cancers — multiple myeloma, AML, non-Hodgkin

    15:45 FidoCure / Fetch — 2B data points mapping dog mutations to human therapies

    19:42 Bark translation — Michigan 70% published vs Traini 94% unpublished

    26:08 AI at the vet — 798M market, PainFace beats trained vets on pain detection

    29:42 Mars Poopscan + the candy company's $1B pet-health bet

    30:33 Smart collars + facial recognition for lost pets at 98%

    34:14 Robotic companion dogs — 45% PTSD flashback reduction in dementia patients

    37:39 Three predictions


    SOURCES

    Loyal for Dogs — STAY study + LOY-001/LOY-002 FDA submissions

    Dog Aging Project / TRIAD trial — Univ. of Washington + NIH

    ImpriMed — AI-guided chemo selection peer-reviewed papers

    FidoCure / One Health — 671-tumor canine genomic study

    Nature 2023 — dog tumors share signatures with human tumors

    Michigan Wav2Vec2 bark study

    Mars Poopscan + $1B pet-health investment

    Fi Series 3 Plus + Petco Love Lost facial recognition

    Tombot Jennie / Joy for All robotic-pet clinical trials

    40 min
  • System Design Interview: What Interviewers Actually Look For

    System design interviews are partly arbitrary. Interviewing.io analyzed 1,000+ mock interviews. 80% of candidates score inconsistently across them. Same person, different day, different result. Even strong candidates (3-of-4 average) fail 22% of the time. Almost one in four.


    But the same data says preparation matters more than you think. Because consistency is the edge.


    The 6-phase framework that fits exactly into 45 minutes: Requirements (5min). Core Entities (2min). API Design (5min). Data Flow (~5min). High-Level Design (10-15min). Deep Dives (10min). Every major guide — HelloInterview, ByteByteGo, DesignGurus, Interviewing.io — converges on this. The framework isn't structure, it's a time budget. Time is the resource most candidates waste.


    Four evaluation dimensions: problem navigation, solution design, technical excellence, communication.


    Level calibration. Junior: "can they learn?" Mid: "can they build?" Senior: "can they own?" — drives conversation unprompted, brings up consistent hashing, gossip protocols, hot-key mitigation. Staff: "can they lead?" — at staff the system is almost secondary, the question is about the organization. Flagging uncertainties as a strength: "I don't know yet, I'd need to investigate."


    Top 3 questions on every list: URL shortener (ID generation, 99% read traffic), chat (WebSockets vs long polling, message ordering across time zones), news feed (fan-out-on-write vs fan-out-on-read).


    Five numbers to memorize: 1M/day = 12 QPS. Peak = 10X average. Memory is 100X faster than SSD. One server = 1,000+ QPS. Three nines = 8 hours downtime/year.


    Seven failure modes: jumping to architecture, over-engineering, not finishing, ignoring trade-offs, monologuing, name-dropping without depth (the Kafka trap), ignoring operations.


    And the 80/20 rule. DesignGurus: 80% of interviews use only 20% of core concepts — seven building blocks: servers, databases, caches, message queues, load balancers, blob storage, CDNs.


    Plus three predictions for where this is heading (AI-assisted interviews coming within 2 years, top 3 questions won't change for years, 80/20 holds). And the line that ties it together: consistency beats brilliance in an interview. Every single time.


    RELATED EPISODES

    How Netflix, Uber, and YouTube Handle Scale — real production examples for the building blocks

    Behavioral Interviews: What Big Tech Actually Evaluates — companion interview episode

    Platform Engineering Goes AI-Native — what comes after microservices

    How LLM Inference Actually Works — the infrastructure layer questions on AI-system design


    CHAPTERS

    00:00 Cold open — the 22% failure rate for strong candidates

    03:20 Phase 1 — Requirements (5 min, the most important 5 minutes)

    08:23 Phases 2-6 — Core Entities, API Design, Data Flow, High-Level Design, Deep Dives

    12:30 Four evaluation dimensions — problem nav, solution design, technical excellence, communication

    18:04 Level calibration — junior 'learn', mid 'build', senior 'own', staff 'lead'

    20:57 Staff level — when the system is secondary and the organization is the question

    22:50 Top 3 questions — URL shortener, chat, news feed

    23:25 URL shortener — ID generation, 99% read traffic, the gap between real systems and interviews

    24:30 Chat system — WebSockets vs long polling, message ordering across time zones

    32:10 Back-of-envelope — 5 numbers every candidate must memorize

    36:35 Seven failure modes — jumping to architecture, over-engineering, name-dropping

    45:11 Three predictions + the 80/20 rule + consistency beats brilliance


    SOURCES

    HelloInterview — 28-problem catalog + 6-phase framework

    ByteByteGo — system design framework comparison

    DesignGurus — 80/20 rule + 7 mistakes

    Interviewing.io — 1,000+ mock-interview analysis (22% failure / 80% inconsistency)

    System Design Handbook + IGotAnOffer — cross-reference set

    Designing Data-Intensive Applications — Martin Kleppmann

    System Design Primer (GitHub) — free fundamentals reference

    48 min
  • How Netflix, Uber, and YouTube Handle Scale

    Four companies. Billions of users. Same underlying problem, completely different answers. And one shared set of building blocks underneath it all.


    Netflix. 325M subscribers. 1,000+ microservices on AWS. In 2008, a monolithic database corruption took down DVD shipping for 3 days. That triggered a 7-year cloud migration. In 2011 they built Chaos Monkey — software that randomly kills production servers, on purpose, every business day. Open Connect, their CDN, serves 73 terabits per second at a 98% cache hit rate. And they open-sourced almost all of it — Zuul, Eureka, Hystrix, Chaos Monkey, EVCache. Compete on content, not on plumbing.


    Uber. 36-42M trips per day. 202M MAU. The problem isn't bits, it's physical space. They built H3 — a hexagonal hierarchical geospatial index. Hexagons because every neighbor is equidistant (squares have diagonals 41% farther than edges). Finding nearby drivers is effectively O(1). Matching uses a bipartite-graph Hungarian-style algorithm that minimizes total wait across all riders. The closest driver isn't always your driver — because that might leave someone else with a 20-minute wait. Plus hot path / cold path / surge as real-time supply-and-demand code.


    YouTube. 500 hours of new video every minute. 2.7B MAU. ~1B viewing hours per day. ~15% of global internet traffic. Transcoding into H.264 / VP9 / AV1 — AV1 is 10-100X slower to encode but 30% smaller files. Google built a custom ASIC, the VCU, because general CPUs couldn't keep up. Maybe 5 companies on Earth can justify designing their own silicon.


    Spotify. 751M MAU, 290M premium. The real product isn't music — Apple, Amazon, YouTube Music have the same songs. It's recommendations. Hybrid engine: collaborative filtering + content-based audio analysis + NLP on lyrics. Discover Weekly is part exploration, part exploitation.


    Then the four universal building blocks — consistent hashing, cache-aside with TTL, Kafka vs RabbitMQ vs SQS, and Raft consensus (the algorithm designed specifically to be understandable enough to implement correctly, now under every Kubernetes cluster via etcd).


    Closes with three predictions for 2026-2028.


    RELATED EPISODES

    System Design Interview: What Interviewers Actually Look For — the building-block vocabulary applied

    How LLM Inference Actually Works — the infrastructure / hardware layer underneath all of this

    Platform Engineering Goes AI-Native — what comes next after the microservices era

    RAG in Production — the recommendation-engine analog for AI applications


    CHAPTERS

    00:00 Cold open — 4 companies, billions of users, same problems solved differently

    01:18 Netflix — 325M subs, 1,000+ microservices, the 2008 outage that triggered the cloud migration

    07:25 Chaos Monkey — breaking production on purpose, every business day

    09:21 Open Connect CDN — 73 Tbps at 98% cache hit, 400 Gbps per box on FreeBSD

    12:43 Uber — 36-42M trips/day, the physical-space problem

    13:44 H3 hexagonal geospatial index — why hexagons beat squares, O(1) proximity

    15:55 Bipartite-graph Hungarian matching — minimize total wait, not just yours

    18:35 Surge pricing as real-time supply-and-demand across 10,000+ cities

    20:13 YouTube — 500 hours/min, 2.7B MAU, ingest + transcoding pipeline

    21:37 Codec wars — H.264 vs VP9 vs AV1 (10-100X slower encoding for 30% smaller files)

    24:20 The VCU custom ASIC — when designing silicon saves money

    28:15 Spotify — 751M MAU, hybrid recommendation engine, explore-exploit

    35:53 Four building blocks — consistent hashing, cache-aside, queues, Raft

    42:40 Three predictions for 2026-2028


    SOURCES

    Netflix Open Connect engineering blog + Q4 2025 earnings

    Chaos Monkey / Simian Army — Netflix Tech Blog (2011)

    Uber H3 — open-source Engineering blog + GitHub

    YouTube VCU — Google Research ASIC paper

    Spotify Discover Weekly — Spotify Engineering

    Raft consensus — Ongaro + Ousterhout, USENIX 2014

    Karger consistent hashing — MIT, 1997

    45 min
  • How LLM Inference Actually Works

    Every token from ChatGPT, Claude, or Gemini runs through the same chain: tokenization, embeddings, attention, KV cache, quantization, hardware. Each step is the bottleneck somewhere.


    Hero stat: GPT-4-equivalent capability fell from $60 per million tokens (Nov 2021 GPT-3) to 7 cents (April 2026). A 300X collapse in under four years.


    This episode walks the full mechanism, then the economics.


    Tokenization: Llama 3's vocab is 128,000 subword pieces. The tokenizer is trained once and frozen, which is why Chinese, Japanese, and Thai fracture into 2-4X more tokens. Same content, way higher API cost.


    Attention: every token checks against every other — N-squared in sequence length. 100,000 tokens → 10 billion comparisons. The KV cache: a 70B model at 100K context needs 32 GB just for cache, nearly half an H100's VRAM, for a single request. PagedAttention (vLLM) drops waste from 80% to under 4% — 24X throughput.


    FlashAttention: zero writes of the attention matrix to HBM. Quantization: FP32 → INT8 → INT4, 8X memory cut. Speculative decoding: a small draft model runs ahead, the big model verifies — 2.3X faster, mathematically lossless. Continuous batching pushes GPU utilization from 30-40% to 80-90%.


    Hardware: NVIDIA's H100/H200/B200 lineage. AMD MI300X (specs beat H100, software stack doesn't). Groq's all-SRAM LPU — 230 MB on-die at 80 TB/s, 24X an H100's bandwidth. Cerebras WSE-3 — 4 trillion transistors, 21 PB/s on-chip. Plus the Christmas Eve 2025 NVIDIA–Groq $20B licensing deal and the January 2026 OpenAI–Cerebras $10B compute deal.


    The cost timeline: GPT-3 at $60/million → GPT-4 at $30 → GPT-4o-mini at 15 cents → GPT-4-class at 7 cents. Accelerating at ~200X per year after January 2024, driven by DeepSeek and Google undercutting on Gemini.


    Three dated predictions for 2026-2028, ending on the line that ties the whole stack together: memory bandwidth — not compute — is the actual bottleneck of modern inference.


    RELATED EPISODES

    The AI Chip War — hardware story under inference: NVIDIA / Groq / Cerebras + export controls

    Speculative Decoding — the next chapter on inference speed, deepened

    The Real Cost of AI — the economics of running inference at scale

    RAG in Production — the retrieval layer on top of the inference stack

    Computer Use 45X — operational cost layer once inference is cheap enough to loop


    CHAPTERS

    00:00 Cold open — the 300X cost drop

    01:44 Intro and roadmap

    02:08 Tokenization — Llama 3's 128K vocab, the Chinese-fragmentation tax

    04:39 Embeddings — 8,192-dim vectors, ~2B params before processing

    07:38 Attention — Q/K/V, N-squared compute, the long-context cost

    11:23 Model scale — Llama 3 8B/70B/405B, DeepSeek V3's MoE

    13:19 KV cache — 32 GB per request, half an H100's VRAM

    16:44 PagedAttention — 80% waste to under 4%, 24X throughput

    17:55 Quantization — FP16 → INT8 → INT4, AWQ vs GPTQ

    19:49 FlashAttention — zero writes to HBM

    21:02 Speculative decoding — 2.3X faster, lossless

    24:37 Continuous batching and disaggregated inference

    26:14 Silicon — H100/H200/B200, the arithmetic intensity gap

    28:32 Groq's all-SRAM LPU + the $20B NVIDIA deal

    30:34 Cerebras WSE-3 + the $10B OpenAI deal

    32:58 Current pricing across Claude Opus 4.7, GPT-5, Gemini 2.5 Pro

    34:12 The 300X cost-decline timeline, 2021-2026

    35:58 On-device inference — Apple Foundation Models, MLX

    42:04 Three dated predictions for 2026-2028

    43:43 Closing — memory bandwidth is the bottleneck


    SOURCES

    PagedAttention / vLLM — Berkeley (2023)

    FlashAttention-3 — Tri Dao et al. (2024)

    EAGLE-3 speculative decoding — NeurIPS (2025)

    Llama 3 + DeepSeek V3 technical reports (Meta / DeepSeek)

    NVIDIA H100 / H200 / B200 datasheets

    Groq LPU architecture (Groq engineering blog)

    Cerebras WSE-3 / CS-3 specs; AMD MI300X spec sheet

    NVIDIA–Groq $20B licensing deal — CNBC (Dec 24, 2025)

    OpenAI–Cerebras $10B compute deal (January 2026)

    45 min
  • How AI Agents Actually Work

    Gartner: 40% of enterprise apps will include AI agents by end of 2026. And 40% of agent projects will be canceled by 2027. Same number, same organization, same year. This episode pulls apart the architecture under the marketing.


    A chatbot is a function — input in, output out, one round trip. An agent is a while loop. It keeps calling the model until the task is done. That's the entire distinction nobody gets right.


    Four components: LLM (brain), tools (hands), memory, planning loop. The loop runs Observe-Think-Act-Result and caps at 15-25 iterations because more iterations just burn tokens. Every iteration sends the entire conversation history again.


    The academic foundation: ReAct (Yao et al., Princeton + Google, Oct 2022). 34% improvement over reinforcement learning on ALFWorld and WebShop. A language model with a search tool beat systems specifically trained for those environments. The insight: not smarter models, models that can check their work.


    Tool calling: JSON schemas, plain-English descriptions, ~100 tools and 20 args per tool is the reliable ceiling. Vague descriptions cascade — a wrong tool at step three breaks every step after.


    Context management is the part nobody warns you about. Hong et al.: 87% of tokens in coding agents go to navigating the codebase, not writing it. Anthropic's Pokemon-playing agent kept a markdown file for long-term memory. Compaction, retrieval, sub-agents — the last one costs 7X more tokens.


    MCP: Anthropic open-sourced it November 2024. OpenAI March 2025. Google April. Linux Foundation handoff December. 10,000 active public servers, 97 million monthly SDK downloads.


    Devin: compound system, four models, 67% PR merge rate, contributing about a third of commits to a major open-source project.


    Enterprise reality: McKinsey 62% experimenting / 23% scaling. Gartner found ~130 real agent vendors out of thousands — ~95% agent washing.


    The reliability math that explains the cancellations: 95% per-step accuracy → 60% over 10 steps → 36% over 20. Token costs are 70% of agent OpEx; 60-80% wasted in retry loops. Three dated predictions for 2026-2028.


    RELATED EPISODES

    When AI Agents Go to Court — the Workday/Eightfold legal tributary on agentic hiring

    The Loop Closed in the Sandbox — agent autonomy and the capital-heavy/human-light frame

    Computer Use 45X — the operational layer once agent inference is cheap enough to loop

    Claude Mythos — the model behind the next generation of agent capability


    CHAPTERS

    00:00 Cold open — Gartner's two 40% predictions

    00:45 Chatbot vs agent — function vs while loop

    01:46 The four components and the Observe-Think-Act-Result loop

    03:06 ReAct (Princeton + Google, Oct 2022) — 34% over RL

    04:31 How tool calling actually works — JSON schemas and the 100-tool ceiling

    07:14 Context management — Hong et al's 87% navigation finding

    08:17 Anthropic's Pokemon agent and the markdown-memory trick

    09:51 MCP — from Anthropic standard to Linux Foundation in 14 months

    12:24 Framework landscape — Agents SDK, LangGraph, CrewAI, AutoGen

    13:57 Devin — compound 4-model system, 67% PR merge rate

    15:11 Enterprise reality — McKinsey 62%/23%, Gartner's 130 real agents

    17:00 The reliability math — 95% per step → 36% over 20 steps

    17:58 OWASP Top 10 for agents and alignment under stress

    19:13 The cost math — 70% OpEx, 60-80% wasted tokens, model routing

    20:38 When to use an agent — and when not to

    23:12 Three predictions for 2026-2028 and the closing tension


    SOURCES

    Gartner — agentic AI cancellation + adoption forecasts (2025-2026)

    Yao et al. — ReAct: Reasoning + Acting (Princeton/Google, Oct 2022)

    Hong et al. — context-attention degradation in coding agents

    Anthropic — MCP open standard (Nov 2024) + Linux Foundation handoff

    McKinsey — 2025 State of AI

    Cognition Labs — Devin benchmarks + PR merge rates

    OWASP — Top 10 for LLM and Agentic Applications

    Stack Overflow — 2026 developer survey on agents

    25 min
  • Behavioral Interviews: What Big Tech Actually Evaluates

    25% of engineers who pass Amazon's technical bar get rejected on behavioral. At senior level, 63% get downleveled. Not because they can't code — because their stories showed mid-level scope when the role needed senior.


    Every big tech company runs behavioral. They all test different things.


    Amazon: 16 Leadership Principles + Bar Raiser veto. Interviewing.io's compression — lead with customer impact and you cover most of them. Google: four attributes, Googleyness as the disqualifier even if you ace algorithms. Apple: customer experience and shipping minimalism — Amazon-scale brag answers fail here. Anthropic: barred AI in applications May 2025, reversed two months later. Microsoft: Growth Mindset since Nadella. Netflix: Keeper Test, Culture Memo — "I needed approval" is a red flag. Meta: 45-minute Jedi interview, six axes.


    STAR is fine as a starting point. Actions should be 50-60% of your answer; most candidates do the opposite. STAR ends at Result — interviewers want Learning. CARL: Context-Action-Result-Learning. Google's STAR-L adds 15% on what you'd do differently.


    Decode-Select-Deliver: the framework that beats memorizing dozens of stories. Decode what signal the interviewer wants. Select the largest-scope story even if it's not a perfect fit. Deliver four to five versatile stories that flex across questions.


    Junior vs staff is scope. Same disagreement story sounds different at L4 vs L6. Worked examples in the episode: disagreement, failure, ambiguity, influence-without-authority, Amazon Earn Trust — weak version vs strong version, with specific numbers.


    The 10 mistakes that sink most candidates: no impact metrics, conflict-detail trap, 'we' vs 'I,' naming Leadership Principles at Amazon, too much setup, sanitized failures, winging it.


    Interviewing.io scored 1,000+ technical interviews: only 20% of candidates perform consistently. The other 80% show major variance — a third of high-mean candidates bombed at least one round. Biggest predictor of success: number of practice interviews. AI is making behavioral more important, not less — in-person rounds rose from 24% to 38% (2022-2025) because behavioral can't be gamed.


    RELATED EPISODES

    System Design Interviews — sister episode on the technical rubric

    The AI Layoff Gap — Anthropic-banned-AI-in-hiring quote in its labor context

    When AI Agents Go to Court — Workday/Eightfold algorithmic-hiring case the AI-in-application bans foreshadow


    CHAPTERS

    00:00 Cold open — 25% rejected, 63% downleveled

    00:45 Company rubrics — Amazon's 16 LPs and the Bar Raiser

    01:32 Google's four attributes and the Googleyness disqualifier

    02:05 Apple's customer-experience filter, Anthropic's brief AI-in-apps ban

    03:28 Microsoft's Growth Mindset, Netflix's Keeper Test and Culture Memo

    07:05 Meta's Jedi interview

    07:32 Why STAR breaks down — actions should be 50-60% of the answer

    08:14 CARL, STAR-L, and the Decode-Select-Deliver framework

    09:38 Junior vs staff is scope — and why 63% get downleveled

    11:00 Worked example: disagreement at weak vs strong level

    12:19 Failure question, ambiguity question, influence without authority

    15:18 Amazon Earn Trust — be honest, not nice

    15:57 The 10 mistakes from 500 Amazon + 1,000 Meta interviews

    17:31 How interviewers actually score — Google 1-4, Amazon Bar Raiser

    18:42 Interviewing.io: only 20% of candidates perform consistently

    20:34 Why AI is making behavioral more important, not less

    21:21 The playbook


    SOURCES

    Interviewing.io — analysis of 1,000+ technical interviews

    Amazon — 16 Leadership Principles + Bar Raiser process

    Google — Project Oxygen + hiring committee structure

    Netflix — Culture Memo, Keeper Test

    Anthropic — May/Jul 2025 hiring AI-use policy reversal

    Microsoft — Satya Nadella's Growth Mindset rollout

    Meta — Jedi interview rubric (former hiring committee chairs)

    Triplebyte / IEEE — in-person vs remote interview trends 2022-2025

    23 min
  • AI in the Physical World: The Companies Closing the Loop

    AI training on internet text has hit a ceiling. The next frontier is physical reality — data you can only get by running experiments, moving robot arms, flying drones through smoke. Four companies closing that loop.


    Periodic Labs. $300M seed, pre-revenue. AI scientists paired with robotic chemistry labs. Fully autonomous loop: foundation models hypothesize materials, DFT simulations sanity-check, robots synthesize in a wet lab, AI analyzes results, the loop restarts. 71% autonomous synthesis success rate. Founded by Liam Fedus (co-created ChatGPT, built OpenAI's first trillion-parameter network) and Ekin Dogus Cubuk (led DeepMind's GNoME). A16z tested frontier LLMs at Stanford Applied Physics. Verdict: "objectively terrible at physics." Their words.


    Physical Intelligence. $5.6B valuation, pre-revenue. One universal robot brain — pi-0, 3B parameters, flow matching instead of diffusion. ~100X faster sampling. 73 milliseconds end-to-end on one consumer GPU. Open-sourced — the Android of robotics. The catch: prompt sensitivity. "Close the toilet" 0% success. "Close the white lid of the toilet" 100%. Same task, different words. Until that breaks, you cannot put this in someone's home.


    Seneca. Autonomous firefighting drone swarms. Founder Stuart Landesberg previously built Grove Collaborative (sustainable household cleaning). The wildfire gap: 10-minute containment window vs 30-60 minutes for a fire engine.


    Carbon Robotics. $100M ARR. Already deploying. 10,000 weeds destroyed per minute — 167 per second — zero chemicals. 24 CO2 lasers, 36 cameras, 24 GPUs on a tractor. 4.7M plant images per hour — more visual throughput than most self-driving cars. Large Plant Model trained on 150M+ images from 100+ farms across 15 countries. PlantProfiles: few-shot learning on an iPad in the field.


    Three predictions. Plus the framework: sense, decide, act, learn, repeat. The ones who close the loop fastest win.


    RELATED EPISODES

    Humanoid Robots — the hardware story under Physical Intelligence's pi-0

    How AI Agents Actually Work — the digital side of the same sense-decide-act-learn loop

    The Simulation Hypothesis — what happens when the loop fully closes

    How LLM Inference Actually Works — the inference cost layer beneath every robot brain


    CHAPTERS

    00:00 Cold open — 4 companies, AI that touches atoms, not chatbots

    01:37 Thesis — the next AI training data is physical reality, not internet text

    02:07 Periodic Labs — the autonomous AI scientist + 5-step loop

    05:19 Why frontier LLMs are 'objectively terrible at physics' (A16z + Stanford Applied Physics)

    07:29 The founders — Liam Fedus (co-created ChatGPT) + Ekin Dogus Cubuk (DeepMind GNoME)

    14:13 Physical Intelligence — pi-0, the universal robot brain at $5.6B pre-revenue

    17:29 Flow matching vs diffusion — 100X faster sampling, 73ms on one consumer GPU

    19:53 The prompt-sensitivity gotcha — 'close the toilet' 0% vs 'close the white lid' 100%

    26:33 Seneca — autonomous wildfire drone swarms (founder previously sold dish soap)

    36:56 Carbon Robotics LaserWeeder — 10,000 weeds/min, zero chemicals, $100M ARR

    39:33 The Large Plant Model + PlantProfiles few-shot learning on an iPad

    49:02 Three predictions — pi-0 default by 2028, Carbon to $1B by 2030, Periodic as the biggest coin flip in AI


    SOURCES

    Periodic Labs — A16z investor letter + founding announcement

    Physical Intelligence — pi-0 technical paper (flow matching for VLA models)

    DeepMind GNoME — Nature paper on materials-discovery graph networks

    Carbon Robotics — LaserWeeder specs + Paul Mikesell interviews

    Seneca / Stuart Landesberg — Grove Collaborative founder interviews

    A16z 'objectively terrible at physics' — Stanford Applied Physics report

    Robotics market — $260B global robotics by 2030

    52 min

About Deep Dive

From the publisher's feed

Deep Dive is long-form research on AI, tech, and the global economy. Single host, weekly episodes, 25-35 minutes each. The story behind every headline — built from primary sources and original analysis.