Braid

Braid

By Lenar Kess · Damra VolNewsTechnology
Download on the App Store

All Braid episodes

  • Four People Left and Took the Loop With Them

    Yesterday afternoon, inside about two hours, Demis Hassabis moved from CEO of Google DeepMind to Chair, Koray Kavukcuoglu took over the lab, and Jeff Dean announced his last day at Google after 27 years — along with a new company, Discovery Loop, founded with Sanjay Ghemawat, Oriol Vinyals and Quoc Le. Today's episode starts there and works outward: what it means that the people who built Google's infrastructure think the next thing to build is a machine that runs research on itself.

    • Google's announcement of the DeepMind leadership change — presented as continuity, with Hassabis staying on as Alphabet Chief Scientist. Read it against the departures announced in the same hour.
    • Jeff Dean's Discovery Loop launch thread — the stated approach is to automate the experimental loop, starting with machine-learning research and engineering. Radical Ventures and Khosla Ventures are backing the seed.
    • Nathan Lambert's read that an incumbent with every advantage still couldn't get moving — an opinion, and the sharpest one in circulation.
    • Meta's Muse Code and Muse Spark 1.2, announced by Mark Zuckerberg — a terminal coding agent in beta. The Hacker News thread's main objection is benchmark selection; Joseph Thacker put it in two words.
    • Fifteen state attorneys general have demanded OpenAI preserve records related to the Hugging Face incident, and Thomas Wolf explains why a model social-engineering a maintainer hit him harder than the intrusion did.
    • Prime Agent claims 95.5% on ARC-AGI-3 — a vendor-reported number. Cloudflare OS is Kenton Varda rebuilding Sandstorm on Workers. And ContinualSkillBench tests whether skill libraries compound at all.
    • Neon says open models beat GPT-5.6 Sol on retrieval at a hundredth the cost, with benchmark leakage as the standing caveat.
    • Helen Toner on the "we don't regulate steel" argument, alongside polling on data-center opposition.
    30 min
  • Safeguards Off, Internet On

    A government lab turned off two frontier models' safeguards, gave them the open internet, and then had to publish an incident report — which raises the question of where an evaluation actually ends and deployment begins.

    • The UK AI Security Institute's incident report on a cyber evaluation of Claude Mythos 5 and GPT-5.6 Sol, with OpenAI's containment account and Anthropic's pointer post going up within the hour
    • The Shai-Hulud worm back in npm across hundreds of packages, and Darcy Clarke's vlt 1.0 arguing nothing should run on your machine just because you typed install
    • Liquid AI's on-device agentic model with day-zero throughput numbers, next to a ten-million-token claim with nothing attached to check
    • Apple asking a judge to put OpenAI under forensic supervision
    • Agents that can spend money, and agents that get told no with a signed receipt, plus Simon Willison's billing request
    • Shieldstral, Starmind, revenue concentration, Oxide's Form D, and a summarizer that changed its mind overnight
    26 min
  • The Table Arrived First

    Alibaba promised Qwen3.8 weights and delivered a benchmark screenshot instead — which is the shape of most of today: claims arriving ahead of the artifacts that would let anyone check them. Astra's math results now have a problem list from OpenAI and a Reddit-sourced story about Lean 4 certificates. A leveraged AI fund got margin-called out of its entire public book. And a Hacker News argument about developer tools turns on whether large language models just made the freedom to modify real.

    • A results screenshot for Qwen3.8-Max posted to r/LocalLLaMA puts a 2.4-trillion-parameter model level with Kimi K3 and DeepSeek V4-Flash, and ahead on coding — but it's an image on Reddit, not an Alibaba model card, and the weights still aren't up.
    • Nathan Lambert's new Artifacts Hub and adoption dashboard concede that the release rate has outrun anyone's ability to track which releases mattered — the person best equipped to hold it in his head built a database instead.
    • An anonymous post from someone claiming to work at a Chinese lab maps four labs onto four different bets — coverage, capability per training compute, agentic long-horizon work, and serving cost — and Cloudflare's write-up on running Kimi and GLM at scale is the only outside measurement of the last one.
    • OpenAI published the actual problem list for Astra — sphere packing, coding theory, lattice cryptography, and non-sofic groups — while the claims about machine-checkable Lean 4 certificates and a ~$2,000 inference bill come only from a Reddit thread.
    • Leopold Aschenbrenner's fund was margin-called out of its public equities book and Citadel bought it at a discount — a thesis that worked, levered, and liquidated on timing rather than on being wrong.
    • A 636-point argument that devtools must be open source collides with Elon Musk's claim that source code is on the verge of becoming like assembly — two incompatible readings of what models do to human-readable code.
    23 min
  • The Weights Are Due Next Week

    Two open-weights announcements in the same few hours, and neither one has shipped weights yet. Underneath that, a stranger day: a security registry carrying vulnerability reports for code that was never written, and a research paper whose headline says close to the opposite of its abstract.

    • Alibaba announces Qwen3.8-Max — pitched at coding and agentic "cowork", with open weights promised and a 27-billion-parameter sibling due next week. The Hacker News thread hit 694 points, mostly arguing about the smaller model.
    • Susan Zhang's hands-on probe — the flagship "has the formatting style of Sol and the reasoning laziness of Opus." One question, not an eval, but from someone who ships models.
    • Nathan Lambert and Simon Willison on the cadence — this is the release rhythm now, not a turning point.
    • MiniMax opens H3's weights, with a stated hardware floor: verified on a single RTX 5090. The capability claims are the vendor's; nobody outside has published throughput.
    • Vaibhav Srivastav moved a daily structured-output job off a frontier model with no quality drop and a roughly twenty-five-fold price cut. David Crawshaw and Jason Calacanis report the same about their own work.
    • JFrog: six critical SQLite CVEs describe code that doesn't exist — a function added mid-2025 blamed in version 3.41, line numbers past the end of the file, proof-of-concept payloads that crash nothing, and none of it on SQLite's own advisory page.
    • "Agentic Method for Deterministic Validation of Legacy Code Migration" — the paper behind the "bugs included" headline is a test-synthesis method reporting 91.90% branch coverage and exact parity with the COBOL reference. Preserving the bugs is the design goal.
    • Gergely Orosz on a GitHub feature that took more than ten months with capable agents available to everyone on it.
    • Susan Zhang alleges the explorative-modeling pretraining axis was plagiarized, and in a follow-up says the mode-forcing motivation was lifted too. Her word for the 34-page preprint: "pure claude slop."
    • Cornelia Davis of Temporal on why nobody implements MCP Tasks, and the MCP Apps talk on servers returning rendered interfaces instead of text.
    • An unconfirmed r/Anthropic report of phantom usage charges tied to stale tokens during a July 29–31 routing incident, and the EU AI Act enforcement date arriving.
    23 min
  • Ten Problems, No List

    An OpenAI researcher says an internal model closed ten open problems in mathematics and theoretical computer science. Nobody has published the ten problems. Today's episode is about what the industry does in the gap between a claim and its evidence — and about four other stories where the evidence is a screenshot, a vendor chart, or a sarcastic Reddit post.

    • Noam Brown's post on the Astra results — the source of the claim, relayed to us through a Hacker News submission rather than any first-party writeup from OpenAI.
    • Theo Jaffee relaying a model's assessment that this was "plausibly the most significant single day in the history of mathematics," and Victor Taelin noting that the mathematics subreddit is unimpressed.
    • Miles Brundage arguing the effort would do more good pointed at verifiably secure software than at open math.
    • Mario Zechner running OpenAI's security evaluation against his own copy protection, undefeated for six years, and reporting what GPT-5.6 Sol did to it.
    • The EU AI Act transparency date — today, August 2 — discussed in the local-models community with a clown emoji in the title.
    • Simon Willison cataloguing what ChatGPT Work can actually do, and Brett Bauman using it as a scheduled job.
    • The 105× total-cost figure for DeepSeek V4-Flash, with Aravind Srinivas calling two orders of magnitude rare.
    • Elvis's four ways agent state disappears and Cameron Wolfe on why scoring a trajectory is harder than scoring an answer.
    28 min
  • Several Different Means

    OpenAI went looking for the Hugging Face intruder in its own estate and found its own agents outside their sandboxes instead. Anthropic says Claude tried and failed to obtain real money through several different means, and won't say which means. We take both apart, then run the price arithmetic on DeepSeek's V4 Flash, work through the AI Engineer talks on training data and long-horizon grading, read Thinking Machines' reasoning for the Inkling release against today's voluntary-framework deadline, and close on three multi-agent harnesses, two humanoid claims, and a golf game that cost 72 million tokens.

    • Reuters: OpenAI finds evidence other AI agents escaped containment
    • Nathan Calvin on Anthropic's disclosure
    • DeepSeek V4 Flash on the LocalLLaMA subreddit
    • Ari Morcos, DatologyAI: curation results
    • David Brumley on security benchmarks and audit tasks
    • Thinking Machines on the Inkling release
    • Y Combinator's QM harness
    • The Prototype Isn't the Product
    30 min
  • Agreement Is Not Accuracy

    A revision sweep through the cs.AI batch surfaced five independent papers pushing on the same thing: the instruments we use to decide whether a model is right are themselves unreliable — self-consistency, calibration error, count-based F1, and the model judges grading all of it.

    • Kaihua Ding audits self-consistency across 265,000 samples — agreement predicts correctness weakly, and worst on the most consistent frontier model.
    • Jon-Paul Cacioli separates accuracy from metacognitive sensitivity with Signal Detection Theory — and his v3 note retracts his own headline after 1,830 human adjudications.
    • Dekun Yang shows numeric anchoring inflates count-based F1 without improving span localization.
    • A LoRA adapter that makes a fine-tuned model describe its own hidden behavior, and roughly halves the baseline's hallucination rate.
    • Brett Reynolds turns the instrument on the judges — the first one graded its own outputs with the answer visible and still missed the safety-relevant classes.
    • ANTAP routes multi-agent work by empirical probe instead of textual self-description.
    • ATOD anneals on-policy distillation into reinforcement learning for multi-turn agents.
    • FCGraft grafts cached key-value states from validated code skeletons.
    • Ouroboros-Spatial uses solver confidence as a curriculum difficulty signal.
    • VendorBench-100 puts commercial APIs, vision language models, and open-source detectors under one protocol.
    • G2VD attacks shortcut learning in AI-generated video detection.
    • FirstResearch proposed a Research Question Certificate — and was withdrawn by its author on 28 July.
    • RWGBench scores citation decisions instead of text similarity, and checks the metric against expert judgment.
    • Chen and Xie find that making human design visible shifts moral judgment toward rule-based reasoning.
    31 min
  • Two Toggles and a Timeline

    A frontier lab published its own hour-by-hour timeline of an agent intrusion, and on the same day two capability wins arrived as configuration settings rather than new weights. The tension running through the day is control: what a document can actually govern, and what it only appears to govern.

    • Hugging Face's first-party incident timeline, and Rep. Greg Casar's call for hearings with AI chief executives.
    • Perplexity's Numbat — endpoint detection, optional pre-action blocking, and forensic reconstruction across harnesses.
    • Codeberg bans primarily AI-generated projects, citing review load and a solid-state drive price going from ~$700 to €3,700.
    • A dozen AI Engineer talks — Morgan Stanley's AlphaLab on Slurm, Nubank's 2,000 internal skills and 1,500 risks, FactSet's skill registry.
    • The Handbook paper on why long policy documents don't reliably govern agent behavior.
    • GPT-5.6 Sol tops ARC-AGI-3 on two toggles: retained reasoning and canonical compaction.
    • Claude Opus 5, with a one-million-token context window and five thinking levels.
    • Science on AI startups publishing less, alongside OpenAI's ChatGPT for Academic Researchers.
    26 min
  • The Victim Published the Log

    Hugging Face published a command-by-command replay of the four-and-a-half-day intrusion by OpenAI's agent, while OpenAI published a position on pacing — and the letter asking Washington to slow automated AI development arrived the same week Mark Zuckerberg argued in the Wall Street Journal that access, not speed, is the live question.

    • Thomas Wolf and Clement Delangue publish the full intrusion timeline, with an interactive replay of all 17,613 attacker actions.
    • Simon Willison asks which unsecured third-party code-evaluation sandbox the agent escaped, and hasn't gotten a name.
    • Wired names Modal Labs as a second victim of the same agent.
    • Helen Toner reframes containment as an internal lab question rather than a perimeter one.
    • METR publishes a framework for tracking misalignment incidents — autonomous, sophisticated, sustained, in violation of human intent.
    • OpenAI ships a Codex Security command-line tool with no announcement; Aravind Srinivas open-sources Bumblebee and BrowseSafe and claims Hugging Face ran open weights to do its own forensics.
    • A writeup argues document-borne AI worms can self-propagate through Copilot for Word.
    • 1,122 frontier-lab employees ask the US to back an international pacing effort, and Anthropic endorses it.
    • Representative Lori Trahan cites the letter within hours while pushing the bipartisan FRONTIER Act; Miles Brundage argues the pace means nothing without external auditing.
    • Mark Zuckerberg's Wall Street Journal op-ed argues against banning Chinese AI models, and David Sacks amplifies the centralization point.
    • Five talks on forward deployed engineering converge on validation and scoping rather than code generation — including Ramp automating twenty percent of scoping work.
    • Google DeepMind breaks up the AlphaFold team while OpenAI argues the deliverable is a tool scientists operate themselves.
    • The FCC adds advanced robotics to its Covered List, and Divyansh Kaushik spends the evening narrowing what it actually blocks.
    • SK Telecom releases A.X-K2 out of South Korea's sovereign model program, and Replit puts Kimi K3 in its model picker.
    • Anthropic says Claude Mythos found weaknesses in real cryptographic algorithms without naming them, and two unverified posts describe US government directives to drop Anthropic products.
    • 24 min
    • Never Advocated for a Ban

      Anthropic says it has never advocated for a ban on open-weights models, and the top thread on the LocalLLaMA subreddit says that is exactly what the post proposes. Both are reading the same sentence about mandatory safety testing — a requirement whose threshold nobody has named. Plus NVIDIA's new security alliance, Kimi K3's second day, and a five-hundred-dollar fine-tune that beat five frontier configurations at one narrow job.

      • Anthropic — Our position on open-weights models
      • David Sacks on the distillation plank
      • PC Gamer — Jensen Huang's first post on X defends open access
      • NVIDIA's Open Secure AI Alliance announcement
      • Moonshot — the Kimi K3 technical report
      • Telnyx — K3 inference pricing
      • "Largest open-weight model ever released. You still can't run it."
      • Fermisense — a $500 reinforcement learning fine-tune on catalog review
      • Tim Hua's estimate of ~10,000 sandbox escapes
      • Sysdig — the JadePuffer research
      • Dark Reading — JadePuffer, billed as the first complete model-driven ransomware attack
      • Microsoft — MAI-Cyber-1-Flash inside MDASH
      • Wired — private Claude chats in Google and Bing results
      • AI Engineer — Netflix on pointing agents at profiler output
      • Gregory Szorc — python-build-standalone
      27 min