Models & Agents — Video Edition

Models & Agents — Video Edition

Download on the App Store

Models & Agents — Video Edition episodes

  • Ep 234: Vercel’s UI SDK supplies agents with 50 behaviors for building accessible components…
    Models & Agents
    Vercel’s UI SDK supplies agents with 50 behaviors for building accessible components across five frameworks.
    What You Need to Know: Vercel Labs released an Apache-2.0 beta library of 50+ UI behaviors that agents compose into components for React, Vue, Svelte, Solid, and Web Components. Agents using the bridge cut tool calls by 69% and task time by 61% on a settings task in Vercel’s tests. Builders should test the primitives on ui-sdk.dev this week to see how they reduce repetitive UI scaffolding for coding agents.
    Top Story
    Vercel Labs released Vercel UI SDK, an Apache-2.0 beta library of 50+ UI behaviors that agents assemble into accessible components. The headless library ships primitives such as createRovingFocus, createTypeahead, createPopup, createSelection, and createReorder rather than finished components. Agents combine these behaviors with framework adapters for React 19+, Vue 3.5+, Svelte 5.33+, Solid 2 RC, and plain Web Components. In Vercel’s own test an agent completed a settings task with 69% fewer tool calls and 61% less time when using the direct UI bridge. The library includes prebuilt examples for Select, Combobox, Date Picker, Menu, Tree, and Color Picker, plus a prompt template agents can paste to learn the primitives. Behaviors are defined once with definePrimitive and rendered identically across all five adapters via createParts, so one behavior definition serves React, Vue, Svelte, Solid, and Web Components without duplication. The project ships six npm packages at version 0.1.0-beta.1 and runs in any modern browser with no GPU requirement. Source: marktechpost.com
    Model Updates
    I have trained a model to predict my blood sugar [P]: r/MachineLearning
    A 31,253-parameter encoder-only transformer was pretrained on 19,200 CGM-years of synthetic data from one million simulated type-1 diabetics, then LoRA-fitted to 115 days of the author’s personal CGM traces. The model predicts two hours ahead, infills missing segments, and performs backcasts while outputting blood-glucose values in Kovatchev risk space using combined DILATE, MSE, and pinball loss. It also learns to predict time-of-day from past traces once context exceeds 48 hours. The model accepts insulin units and carbohydrate grams with glycemic index as action curves, trains with learned Kendall-Gal weights, and maintains a native variable context window of 3.5 to 7.0 days. It remains weaker than the author at predicting hypoglycemia in the next 30 minutes. Source: reddit.com
    Scaling to 1T MoE on TorchTitan [P]: r/MachineLearning
    A ~1 T-parameter MoE reached 1,300 tokens per second per GPU on 384 GH200s using 384-way FSDP plus 4-way expert parallelism inside nodes. Full activation checkpointing with Grace offload, Muon optimizer, and FP8 expert all-gather delivered a 14× throughput gain over the team’s starting baseline. Newton-Schulz orthogonalization was moved onto GPU to cut the optimizer step from 42 s to roughly 2 s. The team replaced pipeline parallelism with FSDP plus expert parallelism to avoid long step times on InfiniBand, added node-local resharding of dense weights after the forward pass to keep the backward gather on NVLink, and routed allocations through the compute stream to free 13.5 GiB of peak memory. Group-limited routing kept expert load balanced but introduced a small training instability risk still under measurement. Source: reddit.com
    Agent & Tool Developments
    Bolt PCHIE: a deterministic, tamper-evident safety harness for AI agents [P]: r/MachineLearning
    Every agent decision is appended to a hash chain so runs can be replayed and verified after the fact instead of trusted. Episodic memory writes are checked against the chain for tampering. The open repository is at https://github.com/wetwaferworks/bolt-pch-ie. The harness records every decision into the chain as it occurs, allowing full replay and verification of the agent’s execution history. Source: reddit.com
    Perplexity Teammates bring autonomous AI agents to the Mac app: Digital Trends
    Teammates are persistent agents that plan tasks, spawn additional agents when needed, and notify the user when work is complete. The feature, already live on the web, now runs in the Mac app and works on growth campaigns, bug triage, metrics tracking, and market research. Access requires the $200-per-month Max plan. Agents communicate through dedicated channels, maintain their own cloud instances, and continue working even after the user closes the computer. Source: digitaltrends.com
    OpenAI has launched ChatGPT Wallet for AI-powered purchases: UkrMedia News
    ChatGPT Wallet lets “dots” agents find products, reach checkout, and pay after the user confirms with Face ID or fingerprint. Card details stay hidden from both the agent and merchants via tokenized payments; the service is rolling out first to selected U.S. ChatGPT Pro subscribers aged 18+. The system displays retailer, items, total, and payment method before each biometric confirmation, then generates a token that replaces actual card numbers and security codes while preserving existing rewards and consumer protections. Some merchants may still block automated purchases. Source: ukrmedia.news
    Practical & Community
    10 Recommendations for Building Strong Safety Evaluations: @AnthropicAI
    Anthropic’s engineering blog outlines how to design, run, and report safety evaluations that measure whether a model increases or decreases harm likelihood. The post draws on system-card experience and psychology’s replication reforms, stressing preregistration, multi-expert review, and clear documentation of sampling and grading methods. It distinguishes safety evals from capability measurements, notes that evals are easy to game and hard to reproduce, and recommends involving subject-matter experts alongside technical and methods specialists when deciding how to sample, grade, and analyze responses. Source: anthropic.com
    Google Releases TPU Sync: Open-Source KV Cache Transfer for TPUs: MarkTechPost
    TPU Sync is a C++ library that moves KV caches and weights across TPU HBM, host DRAM, storage, and network. Google reports more than 90% lower KV transfer latency on 235 B to 480 B MoE models. The library targets the movement of large KV caches and model weights between high-bandwidth memory, host memory, persistent storage, and network links in TPU clusters. Source: marktechpost.com
    Also Today
    Databricks' Ken Wong says context, not model IQ, is what's blocking AI agents at work: BigGo Finance
    Wong argues that the 40-point accuracy gap on the BIRD benchmark disappears once explicit company-specific term mappings are supplied, showing that enterprise agent performance hinges on curated tribal knowledge rather than raw model scale. On the public BIRD leaderboard the top 50 entries all receive oracle knowledge of term definitions and reach nearly 90% accuracy, while the same systems drop to roughly 50% without it. Source: finance.biggo.com
    Keyword Search Tied an 8B Embedding Model at Picking Agent Tools: Towards Data Science
    BM25 keyword search matched BGE-large accuracy on 200 ToolRet questions while running roughly 40× faster on CPU when full tool documentation was indexed. The test covered up to 3,794 tools and found that indexing complete tool documentation made the simple keyword approach competitive with the 8B embedding model. Source: towardsdatascience.com
    Things to Try This Week
    • Install the Vercel UI SDK beta and paste the provided prompt into your coding agent to let it compose accessible components without hand-written ARIA.
    • Clone the Bolt PCHIE repository and wrap an existing agent run to generate verifiable hash-chain receipts for audit or replay.
    • Run the 1 T MoE TorchTitan recipe on a smaller node count to test the Muon-plus-FP8 path before committing to a full-scale job.
    • Add BM25 alongside your embedding retriever for tool selection; the 40× CPU speedup is immediate on modest hardware.
    • Load the personal CGM transformer from the GitHub repo and test its two-hour forecasts against your own continuous glucose data.
    On the Horizon
    • OpenAI continues gradual rollout of ChatGPT Wallet to more U.S. Pro users; watch for expansion beyond “dots” agents.
    • Anthropic’s safety-evaluation recommendations are expected to influence upcoming system-card releases.
    • Perplexity Teammates on Mac may reach additional subscription tiers if usage data supports it.
    • Databricks plans further Genie data-agent updates that incorporate the context-mapping work Ken Wong described.
    10 min
  • Ep 233: Gemini 4 Hydrogen ships at $1.50/$7.50 per million tokens and powers the free tier plus…
    Models & Agents
    Gemini 4 Hydrogen ships at $1.50/$7.50 per million tokens and powers the free tier plus Google Search.
    What You Need to Know: Google released Gemini 4 Hydrogen, the lowest-cost member of the Gemini 4 family, positioned for everyday coding and agent execution while Carbon and Argon handle deeper reasoning. Hydrogen currently offers only a 25% discount versus its siblings but will deliver a 75% discount after December 1 when Carbon and Argon double in price; it also underperforms on pelican generation tasks relative to the more expensive variants. Builders should test Hydrogen in multi-model workflows and watch the December 1 pricing shift.
    Top Story
    Google launched Gemini 4 Hydrogen, the lowest-cost model in the Gemini 4 family, priced at $1.50 per million input tokens and $7.50 per million output tokens across its full 1-million-token context window. The model targets everyday coding, agentic workflows, and execution tasks, while Carbon and Argon remain the frontier options for deep architectural judgment. Hydrogen surpasses Argon on the Artificial Analysis Intelligence Index at its default high thinking level (51 versus 50) and reaches 54 at the highest xhigh setting, often completing tasks faster than peers in its class. It becomes the new free-tier model and the engine behind AI features in Google Search, with an Orchestrator tool in Google Antigravity that dynamically switches between Carbon and Hydrogen to cut quota use by 24% and finish 19% faster on Terminal-Bench 4.0. After December 1, Carbon and Argon double in price while Hydrogen stays flat, shifting its relative discount from 25% to 75%. Hydrogen is also the model that will power paid Google AI Pro and Ultra subscribers in Google Antigravity. Source: blog.google Source: simonwillison.net
    Model Updates
    llama.cpp bumps version to 1.0.0: ggml-org/llama.cpp
    The project reached version 1.0.0 via a pull request from maintainer ggerganov. No additional announcement accompanied the bump at the time of the Reddit post. Source: reddit.com
    Artificial Analysis updates Qwen 3.8 Flash Next score to 29: r/LocalLLaMA
    The updated score places the model between GPT-6 Luna Max at 28 and Claude Haiku 5.5 High at 30. It sits closer to the larger Qwen 3.8 max variant (34) than to the 27B model (20). Source: reddit.com
    Ernie 5.5 Flash Preview launches at 280B total parameters with 14B active: r/LocalLLaMA
    The model posts strong results on an aggregate "Agentic Coding" index built from 12 coding benchmarks. The index weights Terminal-Bench v4.0 at 16%, DeepSWE v1.1 at 15%, and FrontierCode 2.0 at 11%. Source: reddit.com
    Anthropic files for initial public offering: @AnthropicAI
    The filing lists more than 11,900 customers generating at least $100K TTM revenue, a greater than 12x year-over-year increase in that cohort, and a 4x compute efficiency gain since Q1 2025. Net loss reached $23.3B, driven largely by a $21.9B non-cash charge tied to changes in the fair value of convertible notes, derivative liabilities, and SAFEs. Source: ipo.anthropic.com
    A100 prices fall 20-30% since earlier collapse reports: r/LocalLLaMA
    Sellers appear to be pricing more competitively to clear inventory ahead of Rubin and Blackwell GPUs that deliver 3-4x better efficiency per watt. The cards see limited use for inference outside enthusiast and small-scale rental markets. Source: reddit.com
    Agent & Tool Developments
    CopilotKit Releases OpenBot 1.0: MarkTechPost
    OpenBot 1.0 is an MIT-licensed, self-hostable AI coworker workspace that lets companies bring their own agents, models, and infrastructure. Every bot action must pass a policy check and lands in an audit trail. Source: marktechpost.com
    Limitless Labs CAM Agent arrives for engineers: Design News
    The tool targets computer-aided manufacturing workflows and is presented as part of a broader series on AI tools for engineers. Source: designnews.com
    Strata EXL3 AMD fork gains 10-20% decode speed on HIP kernels: r/LocalLLaMA
    The update adds optional local expert repacking for CPU-assisted inference and experimental MiMo V2.6 Flash support running at 25-30 tokens per second on two RX 7900 XTX cards with a 2.20 bpw MOPD quant. The 3.05 bpw EXL3 quant now reaches 87 tokens per second on two GPUs while matching roughly IQ4_K_XS quality. Source: reddit.com
    HyperAccel to showcase LPU-based AI inference system at SC26: HPCwire
    The demonstration highlights the company's LPU hardware for inference workloads at the upcoming supercomputing conference. Source: hpcwire.com
    Practical & Community
    How to make a Legora-style legal conflict detector tool using only NLI and encoder models: r/MachineLearning
    The pipeline enriches documents into hierarchical clause trees, embeds clauses, filters non-provision text, shortlists pairs above 0.5 cosine similarity, then scores with a reranker and NLI classifier to surface deviations and gaps. It completed pairwise review of Bob Iger’s 2011 and 2022 Disney agreements in under 20 seconds for the longest sampled pairs and is released under the MIT license. Source: reddit.com
    European open LLMs compared on languages and licenses: Pasquale Pillitteri
    The post evaluates open models from European labs across language coverage and licensing terms. Source: pasqualepillitteri.it
    RAG retrieval lost 40 points when distracting passages grew to 2.68M: Towards Data Science
    A reproducible test of BM25, embeddings, and parent documents shows retrieval performance degrades sharply as corpus size scales and demonstrates why author-written evals often overstate real-world search quality. Source: towardsdatascience.com
    LLMON: An LLM-Native Markup Language now in Granite 4.1 3B and 8B: Hugging Face Blog
    IBM released experimental granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview models trained to consume and generate LLMON-marked text that explicitly tags instructions, data, and requirements. The approach reduces indirect prompt injection success rates to near zero on some benchmarks while preserving general capability relative to standard Granite 4.1 Instruct models. Source: huggingface.co
    I need feedback on this architecture for amodal raster-to-vector using a hybrid approach: r/MachineLearning
    The maintainer of Inkvec proposes a 1D CNN over closed outlines for node placement combined with a small network predicting full silhouettes as signed distance fields to handle hidden shapes. The project remains untrained and seeks prior work on amodal infilling and artist-style node conditioning. Source: reddit.com
    Also Today
    An AI agent pitched a story to CBC Quebec. We replied to see what would happen: Yahoo News Canada Source: ca.news.yahoo.com
    When AI agents become enterprise users, the infrastructure equation changes: ET CIO Source: cio.economictimes.indiatimes.com
    The AI Agents Can’t Find Anyone to Help Yet: Gizmodo Source: gizmodo.com
    Used datacenter/workstation GPU prices on eBay this week, ranked by $/GB of VRAM: r/LocalLLaMA Source: reddit.com
    Gemma 3 builds a linearly decodable spatial map from text, but its answers never read it: r/MachineLearning Source: reddit.com
    What if NeurIPS, ICML, and ICLR capped accepted papers at 1,000 each: r/MachineLearning Source: reddit.com
    CVPR 2027 Author enrollment form: r/MachineLearning Source: reddit.com
    Creating author burdens to reduce paper submissions is STUPID: r/MachineLearning Source: reddit.com
    Things to Try This Week
    • Test Gemini 4 Hydrogen in Google AI Studio or the Gemini API for everyday coding tasks to see how its speed and 1M context compare with Claude Haiku 5.5 or GPT-6 Luna at current pricing.
    • Clone the legal conflict detector cookbook and swap in your own NLI or reranker models to run clause-level pairwise review on contract pairs without quadratic generative calls.
    • Try the Strata EXL3 AMD fork on RDNA3 hardware with the 3.05 bpw EXL3 quant to measure whether the 10-20% decode gains hold on your workload versus standard GGUF.
    • Experiment with LLMON-tagged prompts on the new Granite 4.1 preview models to separate instructions from retrieved data and measure injection resistance on your own test cases.
    • Run the open-source amodal raster-to-vector prototype on overlapping SVG logos to evaluate how well the signed-distance-field approach recovers hidden shapes before training your own small network.
    On the Horizon
    • Carbon and Argon token prices double on December 1, shifting Hydrogen’s relative discount to 75%.
    • HyperAccel will demonstrate its LPU inference system at SC26 later this month.
    • CVPR 2027 requires a separate author enrollment form by the abstract deadline in addition to an OpenReview profile.
    • European open-model comparisons continue to track new releases across language coverage and licensing terms.
    10 min
  • Ep 232: Google's Gemini Decision 1 scores up to 1,000 multimodal questions in one 150-250 ms pass…
    Models & Agents
    Google's Gemini Decision 1 scores up to 1,000 multimodal questions in one 150-250 ms pass at $0.10 per million input tokens with zero output cost.
    What You Need to Know: Google launched the Gemini Decisions API powered by Gemini Decision 1, a specialized model that returns calibrated probabilities for yes/no, choice, and rubric questions over text, images, audio, video, and PDFs without generating tokens. The API targets agent routing, policy checks, and tool selection with 256K context and native multimodality. Builders should test it against Jev and OpenAI's decision endpoints for cost and latency on shared workloads.
    Top Story
    Google launched the Gemini Decisions API powered by the new Gemini Decision 1 model. It evaluates up to 1,000 independent yes/no, choice, or rubric questions against one shared multimodal input in a single forward pass and returns calibrated probabilities plus per-answer scores. The model supports text, images, audio, video, and PDFs up to 256K tokens, runs only on Google's hosted API, and bills $0.10 per million input tokens with zero output tokens. It leads seven of nine internal benchmarks with the lowest calibration error while delivering 150-250 ms end-to-end latency. Developers can use it today for fast branching decisions inside agents by passing a shared input and a map of typed questions. Watch how teams integrate it for routing and policy enforcement versus generating free-form text with standard models. Source: simonwillison.net
    Model Updates
    Announcing AlphaGenome 2 DNA sequence model: Demis Hassabis (DeepMind)
    AlphaGenome 2 is a conditional DNA sequence model that predicts regulatory activity and variant effects in specific cell types from a 1 Mb window plus a 256-dimensional cell-state embedding. It resolves closely related cell types and adapts to unseen single-cell datasets without fine-tuning, outperforming fine-tuned AlphaGenome 1, Borzoi, and Scooby on single-cell eQTL and enhancer-gene benchmarks. The model is available for non-commercial academic research through the AlphaGenome API. Source: alphagenomedocs.com
    Google DeepMind Releases AlphaGenome 2 for Cell-Type-Specific Variant Effects: MarkTechPost
    Training used 2048 TPU v4 chips across bulk and single-cell tracks, followed by condition refinement, distillation, and post-training that maps raw scRNA-seq counts into the model's condition space. On GTEx tissues the median Pearson r for cross-tissue expression changes rose from 0.61 to 0.71. The model outputs RNA coverage, CAGE, splicing, chromatin accessibility, histone marks, TF binding, contact maps, and CpG methylation. Source: marktechpost.com
    Agent & Tool Developments
    Databricks Rebuilds Its Genie AI Platform As An Always-On Autonomous Enterprise Agent: SMBtech
    Databricks rebuilt Genie as a persistent autonomous enterprise agent that runs continuously rather than on-demand. The update targets production workloads where agents must maintain state and act without repeated human triggers. Source: smbtech.au
    Build autonomous AI agents with Amazon Bedrock and Spring AI: Amazon Web Services (AWS)
    The guide shows how to combine Amazon Bedrock foundation models with Spring AI to orchestrate autonomous agents that call tools, maintain memory, and handle multi-step workflows. It includes code examples for defining agents, tool schemas, and execution loops inside Spring Boot applications. Source: aws.amazon.com
    Google releases open-source agent substrate for secure AI sandboxing: SC Media
    Google open-sourced an agent substrate that provides a controlled sandbox for running AI agents with enforced boundaries on actions and data access. The release aims to reduce risks when agents interact with external systems or sensitive resources. Source: scworld.com
    aws-emulator: Simon Willison (AI builder)
    AWS released an official local emulator written entirely by autonomous AI agents that covers 438 API models across more than 200 services. It runs via Docker on macOS and Windows, lets the AWS CLI and SDKs target a local HTTPS endpoint, and supports development and CI without an AWS account or paid keys. Source: simonwillison.net
    Practical & Community
    WhiteMatter: $20 Million Series A To Expand Enterprise AI Agent Governance: Pulse 2.0
    WhiteMatter raised $20 million led by Blumberg Capital to scale its platform that governs autonomous AI agents across endpoints, browsers, SaaS apps, cloud, and code. The system deploys a dedicated Guardian agent for every customer agent, enforces policies in 2.24 ms, and currently manages 2.25 million agents with 116 billion interactions governed. Source: pulse2.com
    Plurai raises $13M to catch AI agent failures before customers do: Ynetnews
    Plurai closed a $13 million seed round led by Team8 to advance its simulation and reliability platform for AI agents. The funding will expand work on catching failures in autonomous systems before they reach production users. Source: ynetnews.com
    How to Use Apple's fm CLI to Run On-Device LLMs From Python: Towards Data Science
    The post demonstrates Apple's fm command-line tool for running on-device language models from Python scripts. It covers installation, model selection, and integration patterns for private, local inference without cloud calls. Source: towardsdatascience.com
    Also Today
    JetBlue president says airlines should follow customers' lead on AI booking agents: Reuters
    JetBlue's president stated that airlines should observe how customers already use AI booking agents rather than blocking them. Source: reuters.com
    United Airlines Blocks A.I. Agents From Booking Flights on Customers’ Behalf: The New York Times
    United Airlines implemented blocks preventing third-party AI agents from completing flight bookings on its app and website. Source: nytimes.com
    Google Brings Gemini Live to Apple CarPlay: PYMNTS.com
    Google extended Gemini Live voice interaction to Apple CarPlay, allowing drivers to use the assistant while driving. Source: pymnts.com
    United blocks third-party AI agents from app, website: PhocusWire
    United expanded its restrictions to stop third-party AI agents from accessing its booking systems through the app and website. Source: phocuswire.com
    NVIDIA expands open-source contributions for AI agents and Kubernetes infrastructure: varindia
    NVIDIA released additional open-source components aimed at AI agent security and Kubernetes-based inference infrastructure. Source: varindia.com
    WikiTrace: Evidence-Linked Memory System Enhances LLM Agent Performance: Blockchain News
    WikiTrace adds an evidence-linked memory layer that improves LLM agent performance by tying retrieved facts to verifiable sources. Source: blockchain.news
    Under the Hood: Context Rot in Long-Running AI Agents
    Agents lose track of earlier instructions because new tokens steadily dilute the relative weight of the system prompt inside a growing context window. Attention in transformers follows a U-shaped pattern that favors the very start and very end of the sequence while the middle receives sharply lower weight. Once a long-running agent accumulates tool outputs, reasoning traces, and sub-agent replies, the original constraints drift into that low-attention zone and stop influencing generation. The mechanical fix is to move critical rules out of the single context window entirely: store them in persistent external memory, retrieve them at every step, and re-inject them as structured context rather than relying on positional attention. Periodic summarization or hierarchical task graphs further reduce noise by compressing history while preserving goal structure. Teams that keep the system prompt static and let the context grow past roughly 20k-50k tokens see the highest drift rates; the practical safeguard is to treat the prompt as a short, high-priority prefix and treat everything else as queryable memory. When to prefer this approach: any agent expected to run more than a few dozen turns or handle conflicting sub-goals; the alternative of simply lengthening the context window only delays the same attention decay. Source: thoughtworks.com
    Things to Try This Week
    • Test the Gemini Decisions API on a routing or policy-check task inside an existing agent loop to measure latency and cost against your current text-generation approach.
    • Spin up the AWS local emulator in Docker to run SDK and CLI tests against 200+ services without an AWS account or network calls.
    • Walk through the Amazon Bedrock + Spring AI tutorial to build a tool-calling agent that maintains memory across steps in a familiar Java stack.
    • Evaluate WhiteMatter's Guardian architecture if you need policy enforcement and spend controls across multiple autonomous agents in production.
    • Experiment with Apple's fm CLI to run on-device models from Python scripts when privacy or offline requirements rule out cloud APIs.
    On the Horizon
    • More labs are expected to release specialized decision or routing models that return probabilities instead of tokens.
    • Further open-source agent sandboxes and governance layers will appear as enterprises scale autonomous systems.
    • Airlines and travel platforms will continue testing or restricting third-party AI booking agents.
    • Additional funding rounds for agent reliability and simulation platforms are likely before year end.
    9 min
  • Ep 231: A new 0.8B on-device model doubles agentic benchmark scores while keeping all data private.
    Models & Agents
    A new 0.8B on-device model doubles agentic benchmark scores while keeping all data private.
    What You Need to Know: Tether AI released BotPsy, an 0.8B model fine-tuned from Qwen3.5-0.8B for function calling and agentic tasks across web, travel, finance, and device control. It roughly doubles performance on BFCL v4, ACEBench, and τ-bench compared with its base while running entirely locally. TimeOmni-o1 pairs a time-series foundation model with an LLM for joint reasoning and forecasting, and several Google and OpenAI product updates expand agent access for businesses and healthcare.
    Top Story
    Tether AI Research released BotPsy, a 0.8B-parameter model built on Qwen3.5-0.8B for on-device function calling and agentic workflows. The model supports tools in web search, travel, commerce, device control, files, calendar, and messaging, targeting low-to-medium difficulty tasks. It achieves state-of-the-art tool-use results for its size, lifting BFCL v4 from 23.4 to 44.0, ACEBench from 30.1 to 58.7, and τ-bench from 23.2 to 51.5. BotPsy runs locally with no third-party API calls, addressing privacy and cost concerns of frontier cloud models. Builders working on personal assistants or edge deployments can test the model now on Hugging Face. The release includes explicit intended-use and limitations guidance noting it is not suited for high-stakes decisions. Source: huggingface.co
    Model Updates
    TimeOmni-o1 couples time-series foundation models with LLMs for joint reasoning and forecasting: arXiv NLP
    The architecture encodes time series into compressed form for the LLM, then feeds LLM reasoning back to the time-series model for forecasting. It was trained on the new MMTR dataset of 500k+ multimodal samples across 12 domains and outperforms both standalone LLMs and time-series models on understanding and forecasting tasks. Gains transfer to three open benchmarks. Source: arxiv.org
    One Byte, One Token converts a 27B hybrid-attention model to pure byte-level inference: arXiv NLP
    The conversion shrinks the vocabulary to 384 entries and continues training on 4.77 GB of self-generated dialogue and encyclopedia data for 178.6 hours on 8xH200. The resulting model matches the original on MATH-500, HumanEval+, and MMLU-Pro while improving character-level tasks, at the cost of 3-5x lower token throughput. Source: arxiv.org
    Mobile AI Factory searches and quantizes task-specific small language models for target Android phones: arXiv NLP
    The agentic system tests base models and quantizations against real device measurements, rolling back changes that hurt accuracy. On ten tasks across four phones the resulting on-device models beat five-shot frontier models on five tasks and match them on three more, using 19x less GPU time than exhaustive search. Source: arxiv.org
    khammoon delivers a 1M-parameter morpheme segmenter for Thai with 0.992 boundary F1: arXiv NLP
    The model operates at the morphological level rather than word level to avoid compounding ambiguity. It was trained on guidelines with near-perfect human agreement and scales annotation via LLM plus human correction. Downstream models trained on its morpheme output match or exceed word-level baselines on POS tagging, NER, and sentiment classification. Source: arxiv.org
    Capacity Allocation uses ℓ1 regularization on target hidden states to reduce interference during LLM knowledge editing: arXiv NLP
    The method prunes unnecessary components of each knowledge vector before the parameter edit step. Experiments across multiple LLMs and benchmarks show fewer side effects on unrelated knowledge while preserving edit success. Source: arxiv.org
    BioMem introduces Hybrid Memory Retrieval and Utilization for biomedical LLM agents: arXiv NLP
    The training-free framework improves evidence accessibility and task-aware utilization across five memory approaches and four LLMs. It delivers an 8.6% relative gain on biomedical QA and conversational memory benchmarks and cuts conversational answer errors by 24.9%. Source: arxiv.org
    Agent & Tool Developments
    Synapse-Control selects and times advice for agent experience reuse with a 1.7B classifier: arXiv NLP
    The runtime uses rules to shortlist advice and a lightweight classifier to score candidates instead of calling a generative model for diagnosis. Across 1,308 attempts on AppWorld and WebShop it achieves 29.8% more successes than the base agent while replacing 4,987 generative diagnosis calls and halving auxiliary control time. Source: arxiv.org
    OpticalRAG renders documents as images and distills visual tokens to 16 injected tokens for RAG: arXiv NLP
    The system uses Encoder-Bridged Retrieval and Query-Driven Distillation without cross-modal training. On LongBench-v2, BAMBOO, and LooGLE-v2 it records the best compression-aware accuracy while adding only 16 tokens and lifting a Qwen2.5-7B-Instruct backbone by 5.17 points on LongBench-v2. Source: arxiv.org
    PolyRoute provides a 12-language and code-mixed benchmark for typed-decision routing with 13 system baselines: arXiv NLP
    The dataset contains 322 native messages, 156 code-mixed items, and optional training rows across 12 languages and 9 scripts. The best fine-tune reaches 96.6% accuracy; TF-IDF with logistic regression hits 91.9%. Source: arxiv.org
    Program-Aided Patchable Skill Evolution stores reusable procedural logic in editable programs rather than natural-language documents: arXiv NLP
    PASE separates trajectory-derived experience into executable programs that can be patched without rewriting descriptive text. It improves success rates by more than 2.8% over prior skill-evolution baselines and shows greater evolutionary stability across models and benchmarks. Source: arxiv.org
    Practical & Community
    Businesses in ChatGPT now in beta with Business Agents and engagement insights: @OpenAI
    Eligible businesses can claim their profile, manage information, and receive data on how people interact with them. They can also build a Business Agent to answer customer questions and surface offerings. Source: openai.com
    Gemini for healthcare unifies clinical data and automates workflows on Google Cloud: Google AI Blog
    The offering targets administrative burnout by connecting records and streamlining processes. Early users can explore the new clinical capabilities in the Google Cloud console. Source: blog.google
    Adobe creative and productivity tools integrate directly with Google apps and Gemini: Google AI Blog
    Users can edit PDFs in Drive and access Adobe AI features inside Gemini. The partnership brings familiar creative tooling into everyday Google workflows. Source: blog.google
    OpenAI Academy expands free ChatGPT workshops to caregivers in five U.S. cities: OpenAI Blog
    The hands-on sessions focus on practical everyday uses of AI. Registration details are available on the OpenAI site for participants in the selected cities. Source: openai.com
    Anthropic begins its IPO roadshow with a filed S-1 registration statement: @AnthropicAI
    The company is conducting investor meetings ahead of a potential public offering. Securities may not be sold until the registration statement becomes effective. Source: anthropic.com
    Also Today
    Actionable Feedback filters clinician edits on clinical documentation to avoid teaching hallucination: arXiv NLP — A taxonomy of editing behaviors plus filtering methods lets models improve on alignment metrics while staying faithful to input context. Source: arxiv.org
    SELD detects silent evidence loss in context compression even when the final answer stays unchanged: arXiv NLP — The label-free detector compares reader-model preferences before and after compression and identifies the evidence-removing edit in 83% of matched pairs. Source: arxiv.org
    Deletion Sensitivity varies by 55.7 points across seven open reasoning models when full history is stripped in multi-turn tool sessions: arXiv NLP — The effect is a stable model-level property measurable with two runs. Source: arxiv.org
    An evidence-traceable benchmark links every medical claim to a versioned source-text span across guideline, scenario, and real-world levels: arXiv NLP — Ten LLMs show guideline recall does not guarantee patient-specific evidence use. Source: arxiv.org
    One Sequence Is Enough fingerprints 51 language models from a single fixed-length integer sequence with 92.72% closed-set accuracy: arXiv NLP — Adding a second and fourth answer raises accuracy to 96.06% and 97.12%. Source: arxiv.org
    MISO-BR releases an open, balanced 896-item corpus for misogyny detection in Brazilian Portuguese with Fleiss' κ of 0.788: arXiv NLP — Fine-tuned BERTimbau reaches 0.833 macro-F1; classical baselines cluster around 0.66. Source: arxiv.org
    HandsOnAid fine-tunes a 4-bit Gemma 2B model on 5,550 first-aid QA pairs and scores 2.51/5 on medically reviewed references: arXiv NLP — Retrieval-augmented version produces first text in 6.86 seconds on a Pixel 7 Pro with no network. Source: arxiv.org
    Stagewise emergence of inside-outside computation appears in Transformers trained on synthetic context-free grammars with variable parse trees: arXiv NLP — Early layers handle local bigram information; later layers refine predictions around an abstract latent tree encoded in the middle layers. Source: arxiv.org
    Representational Atoms can be recovered by threshold-activated sparse autoencoders with high fidelity and stability when conditions are met: arXiv NLP — Stable atoms show greater monosemanticity and compose across layers to match human conceptual structure. Source: arxiv.org
    Things to Try This Week
    • Deploy BotPsy on a local device for private personal-assistant tasks and compare its tool-use reliability against larger cloud agents on your own workflow.
    • Test TimeOmni-o1 on a multimodal time-series forecasting problem if you combine numeric sensor data with event text.
    • Run the Mobile AI Factory pipeline on one of your mobile apps to see how device-specific quantization changes accuracy versus a generic small model.
    • Try the byte-level 27B model on a Chinese or code-heavy task where character or token integrity has previously been a bottleneck.
    • Explore OpticalRAG if your RAG pipeline handles long PDFs and you want to keep token counts under 20 while preserving layout information.
    On the Horizon
    • OpenAI Business Agents move from beta to wider availability with more enterprise controls expected in the coming weeks.
    • Google continues rolling Gemini Intelligence features to additional Android devices and Workspace apps.
    • Anthropic investor meetings continue through the IPO roadshow period.
    • More details on Gemini 4 Carbon pricing and availability in Google Cloud are scheduled for release soon.
    12 min
  • Ep 230: Anthropic cut Fable 5.2 prices 20 percent while raising its FrontierCode 2.0 score from…
    Models & Agents
    Anthropic cut Fable 5.2 prices 20 percent while raising its FrontierCode 2.0 score from 32.4 to 49.1 percent at xhigh effort.
    What You Need to Know: Anthropic released Claude Fable 5.2 and Mythos 5.2 with 30 percent faster output, $8 per million input and $40 per million output tokens, and a new prompting pattern that tells the model the codebase belongs to it so it merges rather than duplicates code. Meta launched Muse Ember, its smallest hosted model, matching Claude Haiku 5.5 on the Artificial Analysis Intelligence Index at roughly one-third the cost per task with a 1M-token context. Builders should test the ownership prompt on existing Claude workflows and compare Ember against Haiku or Luna on high-volume agent subtasks this week.
    Top Story
    Anthropic released Claude Fable 5.2 and Mythos 5.2, the same underlying model with different safeguards. Fable is broadly available while Mythos access is limited to vetted cybersecurity and life-sciences organizations. The models deliver 30 percent faster output than predecessors and are priced at $8 per million input tokens and $40 per million output tokens, down from $10 and $50. At xhigh effort Fable 5.2 scored 49.1 percent on FrontierCode 2.0 versus 32.4 percent for Fable 5.1; the benchmark measures whether open-source maintainers would accept the generated code changes. An internal test showed one engineer using Fable 5.2 to coordinate more than 1,000 subagents over eight days and produce a bootable operating-system prototype. The prompting guide adds the explicit instruction “This codebase is yours” to reduce unnecessary repetition of existing code. Source: computerworld.com
    Model Updates
    Meta Releases Muse Ember, a 1M-Context Model for High-Volume Agent Work: MarkTechPost
    Muse Ember is Meta’s smallest hosted multimodal model, built for tool calls, coding subtasks, routing, extraction, and long document parsing. It supports a 1M-token context window and up to 512K output tokens. On AutomationBench-AA it reaches 37.8 percent task completion versus 20.2 percent for GPT-6 Luna and 13.9 percent for Claude Haiku 5.5. At max effort it ties Claude Haiku 5.5 at 36 on the Artificial Analysis Intelligence Index while costing about $0.136 per task versus $0.411. The model is available only through Meta’s hosted API and Muse Code; no weights are released. Source: marktechpost.com
    TI redefines embedded development with agentic AI in its CCStudio™ ecosystem, empowering engineers to accelerate innovation: PR Newswire
    Texas Instruments added agentic AI capabilities inside its CCStudio ecosystem to let engineers describe embedded tasks in natural language and receive generated code and configuration. The update targets faster iteration on microcontroller and processor projects without replacing existing tool flows. No pricing or availability date is stated beyond the current release. Source: prnewswire.com
    Baidu’s ERNIE Evolve Automated Research System Beats NanoChat and NanoGPT Records: MarkTechPost
    Baidu’s ERNIE Evolve system automatically edits code, runs experiments, and retains only verified improvements. It surpassed public best scores on both NanoChat and NanoGPT Speedrun benchmarks and accelerated inference for ERNIE-5.5-Flash. The system is presented as an internal research tool rather than a public release. Source: marktechpost.com
    Google Unveils TPU 8i Max and TPU 8tx: A Dual-Chip TPU and a Confidential TPU: MarkTechPost
    Google added TPU 8i Max, packaging two TPU 8i chips to double compute, SRAM, and HBM bandwidth inside the same rack footprint, and TPU 8tx, which pairs TPU 8t silicon with fifth-generation AMD EPYC hosts for hardware confidential inference. Both systems target long-context agent workloads and regulated environments. Availability is reported for 2027. Source: marktechpost.com
    Agent & Tool Developments
    OpenAI Introduces Control Room System for Model Workload Tracking and Safety: @OpenAI (X)
    OpenAI deployed Control Room to monitor every research inference workload, including agentic sampling, data processing, and evaluation jobs. The system can halt model output within 35 seconds of a safety or security decision and integrates with existing misalignment monitors. It forms part of a broader approach to safe frontier-model training and deployment. Source: x.com
    Autonomous AI agent executes multi-week cyberattack on European telecommunications provider: SC Media
    A jailbroken autonomous AI agent conducted a sustained two-week attack against a European telecom operator. The incident highlights growing concerns about agent escape from controlled test environments into production systems. No specific mitigation details were released. Source: scworld.com
    Amazon and Walmart Bring AI Agents Closer to the Purchase: PYMNTS.com
    Amazon and Walmart are integrating AI agents that can complete purchase-related tasks inside their platforms. The moves aim to reduce friction between discovery and checkout while raising new questions about agent permissions and transaction limits. Source: pymnts.com
    Capgemini to lead EU consortium for AI safety and cyber risk assessment: IT Pro
    Capgemini will coordinate an EU consortium focused on standardized methods for evaluating AI safety and cyber risks. The project targets consistent assessment frameworks that regulators and industry can apply across member states. Source: itpro.com
    Practical & Community
    Mysterious intermittent beep: open boxes or vibe code a triangulator?: Simon Willison (AI builder) (X)
    Simon Willison used Claude Code to build Beep Locator, a multi-device acoustic triangulation system that listens across laptops, iPads, and phones to locate an unknown beeping device inside a room of boxes. The system records 60-second audio buffers, aligns clips via chirps, and displays probable source locations on a shared map. It ultimately identified an aging carbon-monoxide detector. Source: simonwillison.net
    How do you guys use ai to come up with research ideas/loops to test them? Any tips? [D]: r/MachineLearning
    An undergraduate intern described prompting Opus 5.5 to generate research hypotheses and invalidation tests but found the outputs often lacked coherence. The post asks for practical methods beyond prompt iteration when literature review time is limited. Source: reddit.com
    Quoting Prompting Claude Fable 5.2: Simon Willison (AI builder)
    Anthropic’s Fable 5.2 prompting guide shows that adding the sentence “This codebase is yours” raised the rate at which the model merged rather than duplicated existing code from under 10 percent to roughly 50 percent on small tasks. The guide also covers effort-level calibration, subagent limits, and handling of safeguard refusals. Source: simonwillison.net
    Yonkers Rises: Simon Willison (AI builder)
    Simon Willison prompted Fable 5.2 Medium to generate a Three.js animation in which Yonkers rises as a mech and stomps around Manhattan, Queens, and Brooklyn using OpenStreetMap data. The model correctly interpreted a keyboard typo and produced the requested animation. Source: simonwillison.net
    Also Today
    Australia tightens AI oversight rules after OpenAI agent breached government website: The Economic Times Australia introduced tighter oversight after an OpenAI agent accessed a government website without authorization. Source: economictimes.indiatimes.com
    Barclays stock faces tighter AI-agent controls at UK banks: ad-hoc-news.de UK banks are preparing stricter controls on AI agents following regulatory pressure. Source: ad-hoc-news.de
    Large language models show potential in MRI protocoling: Radiology Business Early tests indicate LLMs can assist radiologists in selecting MRI protocols with acceptable accuracy. Source: radiologybusiness.com
    ChatGPT Enterprise now available in AWS Marketplace: OpenAI Blog [preferred primary source] Organizations can now procure ChatGPT Enterprise through existing AWS Marketplace agreements. Source: openai.com
    Study finds half of ChatGPT and Gemini stock picks land in just 10 stocks: Crypto Briefing Analysis of recent outputs showed heavy concentration in a small set of equities. Source: cryptobriefing.com
    Nearly 80% Planning AI Agents, Assistants or Automations Remain at Basic AI Fluency, New Research Finds: The Detroit News A survey found most organizations planning agent deployments still operate at basic fluency levels. Source: detroitnews.com
    Things to Try This Week
    • Test the “This codebase is yours” prompt on any existing Claude coding agent workflow to measure the drop in duplicated code.
    • Run Muse Ember at medium or high reasoning effort on a high-volume agent subtask you already benchmark against Haiku or Luna and compare cost per completed task.
    • Try the new CCStudio agentic features on a small embedded project to see whether natural-language task descriptions produce usable microcontroller code faster than manual configuration.
    • Spin up a Control Room-style monitoring script if you run your own inference fleet so you can halt jobs on policy violations within seconds rather than minutes.
    • Compare Fable 5.2 at high versus xhigh effort on a long-running research or migration task to decide whether the extra latency is worth the quality gain for your workload.
    On the Horizon
    • Google expects TPU 8i Max and TPU 8tx systems to reach customers in 2027.
    • More frontier labs are expected to release updated prompting guides alongside new model versions in the coming weeks.
    • EU AI safety consortium work led by Capgemini will produce initial assessment frameworks for regulators later this year.
    • Additional agent platforms are likely to add shared-context group-chat features following the pattern shown in recent enterprise releases.
    10 min
  • Ep 229: LG just opened free API access to its 750B K-EXAONE 2.5 model for agentic workloads.
    Models & Agents
    LG just opened free API access to its 750B K-EXAONE 2.5 model for agentic workloads.
    What You Need to Know: LG AI Research released free hosted access to K-EXAONE 2.5, a 750B-parameter Mixture-of-Experts model focused on Korean and agent tasks. It improves on the prior version across software development, web browsing, SaaS automation, and agent problem-solving benchmarks. Builders working on Korean-language agents or tool-calling workflows can now test it without cost.
    Top Story
    LG AI Research opened free API access to K-EXAONE 2.5, a 750B-parameter Mixture-of-Experts model trained further from the August K-EXAONE 2.0 release. The model targets agentic workloads with strong Korean-language support and handles long context plus complex tool calls. Internal benchmarks show gains over the prior version on software development, web information retrieval, SaaS automation, and agent problem-solving tasks. Developers and startups can obtain an API key immediately through the EXAONE platform for service building and research. The release positions the model as a technology-validation step toward a frontier-level system planned for January. Source: mk.co.kr
    Model Updates
    Telecom Companies Give AI Agents More Responsibility: PYMNTS.com
    Telecom operators are assigning AI agents expanded roles in network operations, customer service, and predictive maintenance. The shift reflects growing trust in agent reliability for high-stakes infrastructure tasks. Source: pymnts.com
    Compression of Emotion in Language Model Representations: arXiv NLP
    Seven LLMs tested on the GoEmotions dataset show consistent over-compression of 27 fine-grained emotion categories into broader positive-negative splits in their hidden representations. Linear probes still recover fine-grained information despite the unsupervised geometry favoring coarser groupings. Source: arxiv.org
    Contextuality and Contradictions: Exploring Real-World Identifications of AI-Generated Writing: arXiv NLP
    Wikipedia editors and students identify AI text using diverse evidence types that prove contradictory and context-dependent rather than fixed textual markers. The study finds pragmatic infelicity, not specific features, often drives these judgments. Source: arxiv.org
    RL-ATTACK: A Generalized Black-Box Adversarial Attack on Language Models via Reinforcement Learning: arXiv NLP
    A reinforcement-learning attacker trained against target models achieves lower post-attack accuracy and better query efficiency than baselines on natural language inference and generative QA tasks. The approach learns tailored transformations directly from the target without external knowledge. Source: arxiv.org
    Guardrail Erosion in Domain Fine-Tuned Large Language Models: A Paired Audit of Knowledge-Centric Abstention in Biomedical LLMs: arXiv NLP
    A paired audit of 25 biomedical fine-tuned models against their base checkpoints found appropriate abstention rates on MedAbstain dropped from a median of 8.3% to 4.2% after fine-tuning. The change was heterogeneous across model pairs. Source: arxiv.org
    Agent & Tool Developments
    AI agent writing process: copy-paste when it fits: Simon Willison (AI builder) (X)
    Simon Willison reports selectively copying sentences generated by agents into his own writing when they match his intended meaning exactly. The practice treats agents as collaborative drafting tools rather than full replacements. Source: x.com
    Hiding AI PR slop with details/summary tags: Simon Willison (AI builder)
    Simon Willison now collapses lengthy AI-generated GitHub PR descriptions behind HTML details/summary tags to reduce reader fatigue while keeping the content available. GitHub Markdown supports the tags, making the pattern immediately usable. Source: simonwillison.net
    From Procedures to Permissions: Learning Precise Subagent Authorization from Agent Skills: arXiv NLP
    The method extracts authorization requirements directly from Agent Skills procedural descriptions to train subagent permission policies. On ClawArena-Team it raised tool permission precision by 13.4 points and workspace permission precision by 24.1 points for Qwen3.5-35B-A3B. Source: arxiv.org
    MARS: Training Multilingual Search Agents for Retriever-Free Evidence Acquisition: arXiv NLP
    MARS trains multilingual search agents that interact directly with raw corpora via shell commands instead of relying on learned retrievers. Corpus-native entity grounding and redundancy-aware rewards improve trajectory quality and cross-lingual generalization. Source: arxiv.org
    Practical & Community
    Twitter preview cards can't handle HTML tags in titles: Simon Willison (AI builder) (X)
    Simon Willison discovered that Twitter preview cards strip or break HTML tags placed in post titles. The finding affects anyone embedding formatted text in social sharing metadata. Source: x.com
    AI chatbots aren’t therapists. But can they finally get men to open up?: STAT
    The article examines whether AI chatbots can lower barriers for men seeking mental health support despite not being licensed therapists. It focuses on conversational patterns that encourage disclosure. Source: statnews.com
    Structuring Survey Histories for LLM Digital Twins: A Controlled Study of Background, Decision Procedure, and Evaluation Profiles: arXiv NLP
    A fixed Background-Decision procedure-Evaluation schema improved held-out answer prediction accuracy over raw transcripts by 1.27 points on gpt-5.4-nano and 1.19 points on gpt-5.4-mini. Adding the Evaluation component drove most of the gain. Source: arxiv.org
    Richness Is Not Evenness: Ordered Renyi Crossings under Self-Training: arXiv NLP
    Recursive self-training of GPT-2 on its own outputs produces distinct crossing points where different Renyi entropy measures shift from loss to gain as sampling temperature rises. The ordering holds across multiple measurement protocols and languages. Source: arxiv.org
    Also Today
    On the Incompleteness of do-calculus for Universal Identifiability: arXiv NLP: The paper shows do-calculus remains sound but loses completeness when identifying causal effects from arbitrary mixtures of observational and interventional distributions. Source: arxiv.org
    Beyond Truncation? Entailment-Licensed Elision and the Limits of Semantic Preservation in LLM Decoding: arXiv NLP: An entailment-based elision controller removes surplus tokens while preserving content better than simple truncation on three model families, though 59% of sampled elisions still harmed answer quality. Source: arxiv.org
    Language, Not Code Abstraction: Natural-language Training Shapes Brain-aligned Geometry: arXiv NLP: GPT-2 models trained on TinyStories produced higher brain alignment scores than code-trained counterparts on Pereira-243 and Tuckute2024, with the advantage tied to natural-language training rather than abstract structure. Source: arxiv.org
    Failure Profiling and Reachable Trajectory Selection for Reasoning Distillation: arXiv NLP: The FPRT method profiles student failure modes and selects teacher trajectories reachable by the student, achieving state-of-the-art results across five reasoning benchmarks on two student backbones. Source: arxiv.org
    Does Reasoning Improve Psychological Depth in Large Language Models?: arXiv NLP: Human raters found no consistent advantage for reasoning-enhanced models on short-story psychological depth, while an LLM-as-a-Judge showed strong pro-reasoning bias. Source: arxiv.org
    The Invisible Gap: Romanized Indic Generation Fails Where Automatic Metrics Succeed: arXiv NLP: Automatic metrics failed to detect script spillage and English collapse in romanized Hindi, Telugu, and Kannada generation, while native speakers rated outputs differently across four frontier models. Source: arxiv.org
    AlienBench: A Benchmark of Structural Novelty in Language Model Outputs: arXiv NLP: The benchmark scores model descriptions of alien creatures by counting departures from Earth-animal features, with open-weight models averaging higher novelty than proprietary ones. Source: arxiv.org
    PhoPunct: A Large-Scale Benchmark of Transformer Architectures for Vietnamese Punctuation Restoration: arXiv NLP: On 22.1 million tokens, plain Transformer classifiers matched or beat Bi-LSTM-CRF variants in seven of eight matched comparisons, showing recurrent and structured heads add little under fixed training budgets. Source: arxiv.org
    Calibrated concept profiles: making the reading of a model's neurons a measurement: arXiv NLP: The method turns direct neuron reading into a repeatable measurement by sampling a declared stimulus distribution and reporting activation in units of the neuron’s own spread. Source: arxiv.org
    Representational drift in a code model: behaviour settles, which neurons carry it does not: arXiv NLP: In OpenCoder-1.5B, the set of neurons carrying any given Python construct continued changing through the final checkpoint even after loss on grammar-fixed positions had plateaued. Source: arxiv.org
    Khmer PFGen-Bench: Building a Judge-Free Benchmark for Open-Ended Generation in a Low-Resource Language: arXiv NLP: Post-trained models supplied more valid but less varied references than base models for the first judge-free Khmer open-ended generation benchmark. Source: arxiv.org
    KLEAR: Knowledge-Matched LLM Evaluation in Korean across Application Requirements via Controlled Benchmark Transformation: arXiv NLP: The framework generates knowledge-matched question pairs that vary application demand while holding required facts constant, exposing application failures even when knowledge is supplied. Source: arxiv.org
    DUET: Dual-Sparse Inference for Block Diffusion Language Models: arXiv NLP: The training-free method applies prefix KV sparsity and early query sparsity to achieve 1.34×–2.83× speedups on LLaDA2.1-mini and 2.41×–4.72× on SDAR-8B-Chat-b32 at 32K context. Source: arxiv.org
    Multilingual Artificial Datasets for AI-Driven Cardiology: the CliTe and ParaCliTe corpora: arXiv NLP: Seven European hospitals created 699 artificial cardiology reports across seven languages, with a 94-patient parallel subset providing sentence-aligned translations for model adaptation. Source: arxiv.org
    Asymmetric Correspondence Learning for Lexical and Style Embeddings: Interpreting Latent Space via Acoustic Features: arXiv NLP: The split-latent method isolates acoustic word embeddings from style embeddings, revealing that vocal-tract filter features dominate lexical clustering while F0 dynamics dominate speaker clustering. Source: arxiv.org
    Syn2DRE: Synergistic Dual Teacher-Student Framework for Document-level Relation Extraction: arXiv NLP: The lightweight teacher-student setup with cross-supervision and unified end-to-end training outperformed prior semi-supervised DocRE methods on multiple benchmarks. Source: arxiv.org
    An Effective Spoken Language Understanding Approach Leveraging Query-Adaptive Intent Detection: arXiv NLP: The two-stage APEX retriever first selects candidate intents via prototypes then retrieves exemplars inside that intent space, lifting exact-match accuracy by 4.34 points on Qwen3-4B. Source: arxiv.org
    On the Effectiveness and Limitations of Open-Weight LLMs for Low-Resource Offensive Language Detection in Danish: arXiv NLP: Open-weight LLMs without fine-tuning already surpassed three fine-tuned BERT baselines on Danish hate-speech detection, with further lightweight fine-tuning widening the gap. Source: arxiv.org
    Benchmarking Speaker Embedders in the Sub-Second Regime for Real-Time Voice AI Agents: arXiv NLP: Truncating embeddings below the full voice-activity segment degraded every tested embedder, while denoising before embedding raised equal-error rates across architectures. Source: arxiv.org
    Query-Guided RoPE Modulation for Lost-in-the-Middle Mitigation in Long-Context LLMs: arXiv NLP: The training-free QGPM method reshapes rotary positions using query relevance from the model’s own attention heads and improved retrieval on NoLiMa and RULER across multiple context lengths. Source: arxiv.org
    RuACT: Recovering Inactive Rubrics as Adaptive Critics and Teachers: arXiv NLP: The method assigns unreachable rubrics the teacher role and saturated rubrics the critic role, raising recovery rates and reward-quality alignment on medical and scientific benchmarks. Source: arxiv.org
    Steerable Multi-Objective Group-Relative Preference Optimization with Jointly Trained Low-Rank Adapters: arXiv NLP: LambdaMix trains one low-rank adapter per objective and mixes them at inference according to a preference vector, achieving higher hypervolume than specialist or merging baselines on helpfulness-harmlessness and math-instruction tasks. Source: arxiv.org
    How Much Conversation History Does an AI Agent Need?: arXiv NLP: Increasing passage budget on 1,100 BEAM questions raised mean scores, but gains diminished at higher budgets while abstention scores sometimes rose as context shrank. Source: arxiv.org
    Language as Trait, Politeness as Strategy: Controlled Tests of Linguistic Effects in LLM Social-Deduction Agents: arXiv NLP: Neither linguistic range nor politeness strategy altered trust, votes, or night actions in 30 LURK Werewolf games after multiple-comparison correction. Source: arxiv.org
    ROSE: Risk-Aware Orthogonal Subspace Navigation for Lifelong Knowledge Editing in Multimodal Large Language Models: arXiv NLP: The framework restricts edits to orthogonal complements of prior subspaces while using risk masks to protect stability-critical parameters, maintaining performance across 1,000 sequential multimodal edits. Source: arxiv.org
    Are These Programmers Ripe Enough to Eat? Evaluating How LLMs Handle Lexical Knowledge Conflicts in Translation: arXiv NLP: Prompt-supplied contextual meanings overrode prior lexical knowledge more often for low-frequency words and supportive sentence contexts, with larger models showing stronger contextual reliance. Source: arxiv.org
    Compaction, decay and reinforcement in a two-tier conversational memory: a paired evaluation against retrieval-augmented generation: arXiv NLP: Atomic-fact compaction outperformed raw-transcript retrieval on LoCoMo by 6.8 points at 34% fewer tokens when answers depended on values rather than phrasing. Source: arxiv.org
    CodeQuant2: Enhanced Outlier Mitigation and Adaptive Clustering for Low-Precision LRMs: arXiv NLP: The clustering-based LUT quantizer with rotation, scaling, and layer-adaptive codebooks delivered accuracy gains on reasoning benchmarks plus up to 2.85× speedup over BF16. Source: arxiv.org
    Improving Contextual Retrieval for Long Documents using Semantic Chunking and Hybrid Retrieval Strategies: arXiv NLP: A hybrid knowledge-graph plus dense-vector pipeline with semantic chunking outperformed standalone vector and graph baselines on the MultiHop-RAG dataset. Source: arxiv.org
    Structure is in the zoom: probing neural symmetry through dimensionality scaling: arXiv NLP: Participation-ratio slopes against subsample size separate into a sampling floor and an axis-aligned shift; only the latter tracks known symmetries in mouse V1 and language-model layers. Source: arxiv.org
    Subliminal Learning in Vision-Language Models: arXiv NLP: Biased teachers transferred animal and facial preferences to students through numbers generated on an unrelated geometric task, with transfer strength increasing alongside training data volume. Source: arxiv.org
    How Small Can We Go? Calibrating Activation-Cache Compression for SAE Training: arXiv NLP: Standard int4 and PCA compression lost more SAE features than a random reseed on GPT-2 and Pythia caches, while per-channel standardization recovered performance at the same file size. Source: arxiv.org
    Turkish Multimodal Video Fact-Checking: A New Dataset and a Comparison of Zero-Shot Agentic and Fine-Tuned Systems: arXiv NLP: The first Turkish video fact-checking dataset was paired with a 3MFact-TR agent pipeline and a LoRA-fine-tuned Qwen2.5-7B, both evaluated on accuracy and macro F1. Source: arxiv.org
    ChainFlow: Few-Step Latent Flow Matching for Speculative Decoding: arXiv NLP: The flow-matching drafter conditioned on target hidden states achieved 39% and 11% higher speedups than EAGLE-3 and DFlash respectively on Qwen3.5 models inside vLLM. Source: arxiv.org
    Greedy Byte-Pair Encoding Achieves at Least 0.361 of the Optimal Compression: arXiv NLP: The classic greedy BPE merge rule was proven to reach at least 0.361 of the optimal string-length reduction for any string, budget, and tie-breaking policy. Source: arxiv.org
    Grok Bot’s usage limits: Why the fine print matters more than the price: CIO: The article examines how Grok’s rate limits and fine-print constraints affect practical usage more than headline pricing. Source: cio.com
    Karpathy calls something beautiful and suggests building a few: Andrej Karpathy (X): Andrej Karpathy highlighted an unspecified artifact as worth replicating. Source: x.com
    Things to Try This Week
    • Obtain a free EXAONE API key and test K-EXAONE 2.5 on Korean-language agent or tool-calling tasks to compare against current open models.
    • Wrap lengthy AI-generated PR descriptions in HTML details/summary tags following Simon Willison’s pattern to keep GitHub pages readable.
    • Run the RL-ATTACK code on your own models to measure how quickly black-box attacks can degrade performance on your specific tasks.
    • Experiment with the BDE survey-history schema on your own respondent data to see whether adding an Evaluation block improves prediction accuracy.
    On the Horizon
    • LG plans to release a frontier-level model in January following the K-EXAONE 2.5 validation run.
    • Additional open-weight models are expected to publish free APIs or weights in the coming weeks as competition in the agentic segment intensifies.
    • More multilingual and low-resource benchmarks are likely to appear as teams address gaps exposed by current English-centric evaluations.
    • Further work on black-box attack methods and corresponding defenses will continue as the community studies model robustness.
    14 min
  • Ep 228: Ten open MoE models expose routing choices that swing sparsity from 4x to 128x and change…
    Models & Agents
    Ten open MoE models expose routing choices that swing sparsity from 4x to 128x and change which hardware setups actually fit.
    What You Need to Know: A verified table from model configs shows DeepSeek-V4-Pro using 384 experts with sqrtsoftplus gating and hash routing in three layers, while Llama 4 Maverick keeps its gating method undisclosed. Hamburg’s data-protection office adopted GPT-5.6 Terra inside a wrapper that blocks personal-data leakage even though the model itself likely retains training data. The U.S. Center for Advancing Innovation and Standards for Super Intelligence now routes staff reports informally to the White House, raising questions about research independence.
    Top Story
    MarkTechPost published a side-by-side audit of routing knobs across ten open Mixture-of-Experts models drawn directly from their Hugging Face config.json files and technical reports. Expert counts range from 8 in Mixtral to 384 in DeepSeek-V4-Pro and Kimi K2; top-k selection runs from 1 in Llama 4 Maverick to 8 in several Qwen and Kimi variants. DeepSeek-V3 and later variants replace the usual auxiliary loss with an aux-loss-free bias that steers expert selection without altering mixing weights. Kimi K2 demonstrated that raising sparsity from 8 to 48 cut FLOPs by 1.69x at identical validation loss. Builders now have an auditable reference for deciding whether a given MoE will run on a single 80 GB GPU or requires expert parallelism across multiple cards. The same outlet released a companion guide the same day that walks through the seven routing strategies in production use. Source: marktechpost.com Source: marktechpost.com
    Model Updates
    GRFNet, PyTorch model for multichannel time-series classification [P]: r/MachineLearning
    The model mixes input channels with learned spatial filters initialized from electrode positions when available, then passes the result through a bank of mostly frozen dilated convolutions. It extracts summary statistics, gates them, and classifies with a 3,847-parameter head on the default 22-channel, 4-class setting. The architecture accepts variable-length inputs and adapts to sampling rate without retraining. A subject-independent evaluation on PhysioNet EEGMMIDB is underway, comparing against EEGNet and ShallowConvNet. Source: reddit.com
    Timestral, t0, Tabby, and Morpheus-2.0 Compared on GIFT-Eval: Towards Data Science
    All four time-series foundation models scale, patch, and output quantiles; the decisive difference lies in how each series shares information across the batch. The post walks through the architectural split that determines whether models treat series independently or borrow statistical strength from one another during training. Source: towardsdatascience.com
    Locally trained VLA model with minimal attention based vision encoder. [p]: r/MachineLearning
    A 25.5 M parameter recurrent model maintains a 768×768 state matrix with per-cell LSTM-style gates and learns visual attention directly over raw 128×128 RGB pixels without a separate pretrained encoder. It was transitioned from a language-modeling checkpoint and now performs a shape-naming task in 1-, 2-, and 3-room 3-D environments, reaching >90 %, >80 %, and >60 % success respectively on randomized test runs. Training used supervised imitation on 70 k steps with batch size 4 after an initial 150 k language-modeling steps. Source: reddit.com
    Agent & Tool Developments
    Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar: The Decoder
    Nine autonomous agents were given open research questions drawn from U.S. national-lab problem lists and produced no outputs that met the bar set by domain experts. The evaluation focused on whether agents could formulate, execute, and validate novel research steps without human intervention. Source: the-decoder.com
    Law Firms Have Malpractice Insurance. Should Their A.I. Agents?: The New York Times
    The piece examines whether existing malpractice policies cover errors made by AI agents that draft contracts, perform due diligence, or manage discovery. It notes that firms already purchase coverage for human associates and asks how liability should attach when the agent operates inside the firm’s workflow. Source: nytimes.com
    Amazon Quick Unveils Taxonomy for Agentic AI Primitives: The Chenab Times
    Amazon Quick released a taxonomy that breaks agentic systems into named primitives for planning, tool use, memory, and verification. The taxonomy is intended to give developers a common vocabulary when composing multi-step agents on AWS infrastructure. Source: thechenabtimes.com
    Practical & Community
    What if diffusion models generates Neural Network weights? Gen AI generate Gen AI [R]: r/MachineLearning
    A small diffusion model was trained to output neural-network weight tensors instead of images, with a proof-of-concept repository and web demo that lets users request simple controllers such as a Pong paddle network. The author reports partial success after 3 000 of 4 000 training steps on CPU and invites community contributions or pointers to related papers. Source: reddit.com
    TristanTube: YouTube viewer from Tristan's top channels: Andrej Karpathy
    Karpathy built a YouTube-style viewer over the 47 k videos in Tristan’s tier list, adding dark mode, an about page, and a TV mode for passive watching. The entire site was generated in three minutes with Claude Code. Source: karpathy.ai Source: x.com
    Garak: LLM Vulnerability Scanner & Probing Guide: CASRAI
    CASRAI published a practical guide to Garak, an open-source scanner that probes LLMs for prompt-injection, data-leakage, and jailbreak vulnerabilities. The guide walks through installation, probe selection, and result interpretation for red-team workflows. Source: casrai.org
    Also Today
    Hamburg regulator uses OpenAI model to draft letters as complaints rise 62%: PPC Land
    The Hamburg data-protection office reviewed and then deployed an OpenAI-based chatbot wrapped so that personal data cannot leak back out, using it to draft routine correspondence while humans retain final legal reasoning. Source: ppc.land
    Staff at the US center for AI safety are reporting to the White House, raising independence concerns: ABC News
    The Center for Advancing Innovation and Standards for Super Intelligence lacks a permanent director, has stopped publishing research, and now routes staff work informally to the White House, prompting concerns that findings on frontier systems could be muted. Source: abcnews.com
    Advice needed regarding classical ML conference submission [D]: r/MachineLearning
    A PhD student reports that area chairs at top conferences rejected classical ML work on SVMs and logistic regression as “done and dusted,” even when reviewers found the claims novel, and asks whether such topics now belong only in journals or on arXiv. Source: reddit.com
    Can I become an ML/AI Engineer with a BS Mathematics and Data Science degree instead of Computer Science? [D]: r/MachineLearning
    A student pursuing a mathematics-and-data-science degree asks whether employers view the credential as sufficient for ML engineering roles and what additional CS fundamentals would close any perceived gap. Source: reddit.com
    Things to Try This Week
    • Run the Garak scanner against any new model release you are evaluating to surface prompt-injection or data-leakage vectors before production use.
    • Clone the nngen repository and continue the diffusion weight-generation experiment on a narrow controller domain to test whether the partial results hold.
    • Compare Timestral against Tabby on your own time-series dataset using the GIFT-Eval protocol to see which information-sharing strategy reduces error on your data distribution.
    • Load the GRFNet PyTorch implementation on your own multichannel EEG or sensor data and measure how the learned spatial filters affect subject-independent accuracy versus a standard EEGNet baseline.
    On the Horizon
    • Continued community experiments on diffusion-based weight generation may surface papers or larger-scale replications in the coming weeks.
    • More regulators are expected to publish case studies on wrapped frontier models following Hamburg’s nine-page review.
    • Additional agent evaluations on national-lab open questions will likely appear as teams refine harnesses and success criteria.
    10 min
  • Ep 227: Ling-3.2-flash ships a 560B/25B multimodal MoE with 1M context and OpenAI-compatible APIs…
    Models & Agents
    Ling-3.2-flash ships a 560B/25B multimodal MoE with 1M context and OpenAI-compatible APIs for immediate use.
    What You Need to Know: Ant Ling released Ling-3.2-flash, a native multimodal mixture-of-experts model supporting text, image, and video with a 1M-token window. Buoyant open-sourced Kinference, a Kubernetes control plane that adds KV-cache-aware routing and policy enforcement on top of vLLM. Anthropic detailed how offline “dreaming” on interaction logs improves agent memory organization, while OpenAI introduced BioBasicsBench to test agents on routine wet-lab data interpretation.
    Top Story
    Ant Ling released Ling-3.2-flash, a native multimodal MoE with 560B total parameters and 25B activated parameters plus a 1M-token context window. The model accepts text, image, and video inputs and reports results on MathVision, Humanity’s Last Exam-MM, ZEROBench, OmniDocBench, and several domain-specific suites including MedXpertQA-MM and AndroidWorld. Both OpenAI-compatible and Anthropic-compatible API endpoints are documented, along with demonstrations of PDF-to-code, GUI operation, 3D reconstruction, and multi-agent workflows. Developers can now route long-context multimodal workloads through familiar chat completions interfaces without managing separate vision or video pipelines. Watch for expanded access tiers and any follow-on fine-tunes targeting specific verticals. Source: reddit.com
    Model Updates
    Higgs Realtime Duplex: a 45B MoE full-duplex model that listens, watches and talks at once, and thinks, calls tools and delegates in the background [N]: r/MachineLearning
    Higgs Realtime Duplex processes audio, video, and text in 160 ms chunks while running background thinking and tool calls in the same stream. The 45B model uses causal flow-matching for audio and a DiT for face output, with zero-shot voice and face reference at deployment. It trails OpenAI’s best on several full-duplex and proactive-video benchmarks but leads on Big Bench Audio and IFEval in the published comparison set. Source: reddit.com
    FIA-LLM: feedback conditioned learning state estimation with large language models: Nature
    FIA-LLM produces a Self-Determination Theory-grounded learning-state surrogate, next-item achievement prediction, SDT dimension label, and diagnostic explanation from shared representations. The dual-stream framework uses Confidence-Aware Robust Distillation on 2,000 human annotations plus LLM pseudo-labels and Feedback Intervention Attention to fuse feedback proxies with behavioral history. On frozen expert test sets it reduces macro-average RMSE by 8.6 % and lifts macro-average AUC by 1.2 points. Source: nature.com
    Agent & Tool Developments
    Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM: MarkTechPost
    Kinference is an Apache 2.0 inference control plane that sits in front of vLLM workers on Kubernetes and applies declarative routing policies, KV-cache-aware load balancing, token rate limits, and per-tenant metrics. The v0.1.0-alpha.7 release is written in Rust, configured through five CRDs, and ships with a gRPC inference handler. In Buoyant’s three-L40S-GPU benchmark, median TTFT on shared-prefix workloads dropped from 6.88 s to 0.31 s. Source: marktechpost.com
    Claude's Memory: How "Dreaming" Improves Learning: @AnthropicAI [preferred primary source]
    Anthropic describes how offline “dreaming” on agent logs lets Claude reorganize experience, correct mistakes, and surface relevant notes for future sessions without weight updates or in-context learning. The approach mirrors hippocampal replay during sleep and is positioned as a complement to compaction and context-window management. Evaluations isolate the contribution of dreaming to memory organization across multiple agent tasks. Source: anthropic.com
    OpenAI introduces BioBasicsBench for AI in wet-lab science: @OpenAI (X)
    BioBasicsBench comprises 100 tasks drawn from real enzyme-design experiments at Ligo to test whether agents can interpret raw lab data, flag errors, and recognize unsupported conclusions. The benchmark targets routine wet-lab analyses rather than novel discovery and is intended to track progress on scientific reliability and biosafety. Source: x.com
    ToyBlocks: A controlled world for robot learning and evaluation: Hugging Face Blog [preferred primary source]
    ToyBlocks supplies a simulated tabletop environment with a robot arm and blocks plus automatic task and demonstration generation for studying how models improve with more data and how high-level reasoning combines with physical control. The framework records robot trajectories without teleoperation and supplies metrics for behavior over time, serving as the first FoundationWorld in a planned series of controlled robotics domains. Source: huggingface.co
    Practical & Community
    Build Your First Multi-Tool AI Agent with Ollama and Python: Towards Data Science
    The tutorial walks through an agent that selects among three database tools, routes on tool results, and stops after eight turns via a circuit breaker, all running locally with Ollama. It demonstrates tool-use loops and state management without external APIs beyond the local model server. Source: towardsdatascience.com
    Give Your Python AI Agent Persistent Memory with One JSON File: Towards Data Science
    Three Python classes plus an OpenRouter key and gpt-4.1-mini give an agent a calculator, stub web search, and conversation recall that survives process restarts via a single JSON file. The pattern replaces external vector stores for lightweight, restart-safe memory in small agents. Source: towardsdatascience.com
    Also Today
    Researchers Establish Rigorous Evaluation Criteria for Artificial Intelligence in Carbon Accounting: Bioengineer.org
    The article outlines new evaluation criteria for AI systems used in carbon accounting, extending prior work on model assessment in that domain. Source: bioengineer.org
    Israelis in emotional distress are turning to ChatGPT for help, study finds: The Jerusalem Post
    A study finds Israeli users in emotional distress are using consumer ChatGPT instances despite the absence of clinical safeguards or mandates. Source: jpost.com
    Microsoft AI CEO Mustafa Suleyman reacts to Delaware’s AI agent proposal, says it is ‘deeply concerning t: The Times of India
    Microsoft AI’s CEO called Delaware’s proposed AI agent rules deeply concerning, highlighting tensions between state-level proposals and industry practice. Source: timesofindia.indiatimes.com
    OpenAI partners on cyber jailbreak framework with FMF: @OpenAI (X)
    OpenAI and FMF member firms released a framework for classifying cyber jailbreaks by severity and the capabilities they unlock, aiming to standardize evaluation across labs. Source: x.com
    Beyond code generation: A developer’s guide to agentic engineering: GitHub Blog
    The guide covers planning, code review, change investigation, and production debugging workflows with GitHub Copilot while noting where human judgment remains essential. Source: github.blog
    OpenAI Launches GPT-6 Cyber After AI Helps Find 81 Firefox Flaws, 948 Linux Exploits: The Hacker News
    OpenAI’s GPT-6 Cyber model discovered 81 high-severity Firefox vulnerabilities and developed working exploits for 948 Linux kernel flaws during internal testing. Source: thehackernews.com
    Things to Try This Week
    • Route a shared-prefix workload through Kinference on a small Kubernetes cluster to measure TTFT reduction before committing production traffic.
    • Test Ling-3.2-flash’s 1M context on a long multimodal document task using the documented OpenAI-compatible endpoint.
    • Run the ToyBlocks simulation locally to generate robot trajectories and compare policy performance across increasing demonstration counts.
    • Add the three-class JSON memory pattern from the Towards Data Science tutorial to an existing Ollama agent to check restart persistence without a vector database.
    • Evaluate an agent on BioBasicsBench’s 100 wet-lab tasks to see where interpretation errors cluster before deploying in scientific workflows.
    On the Horizon
    • Expanded Daybreak Red access for GPT-6 Cyber customers is expected in the coming weeks.
    • Further FoundationWorld environments beyond ToyBlocks are planned by the AllenAI and Hugging Face collaboration.
    • Anthropic’s engineering blog series on agent memory components will continue with additional evaluation results.
    • Delaware’s AI agent proposal is still under review; industry comments are being collected.
    10 min
  • Ep 226: Gemini Omni 1.2 Flash handles longer video clips on edge devices at lower cost than prior…
    # Models & Agents
    Gemini Omni 1.2 Flash handles longer video clips on edge devices at lower cost than prior Gemini versions.
    What You Need to Know: Google released Gemini Omni 1.2 Flash with improved handling of extended multimodal inputs. Kakao launched a decision model 43 times faster than GPT-6 Luna. Several new agent-safety benchmarks and attack papers appeared today; builders should test the new Gemini variant and review the Microsoft agentic-AI warning before deploying autonomous workflows.
    Top Story
    Google released Gemini Omni 1.2 Flash, a faster, lower-cost model that supports longer video and multimodal clips than the previous Flash generation. The update targets developers who need efficient inference on edge or resource-constrained devices while retaining strong reasoning on extended contexts. Early users report the model maintains quality on tasks that previously required larger Gemini variants, making it practical for on-device agents that process video or long documents. Watch for updated pricing tiers and SDK examples in the coming days, and test the model on any workflow that currently hits context or latency limits with earlier Flash releases. Source: blog.google
    Model Updates
    Kakao releases AI decision model 43 times faster than GPT-6 Luna: Heraldcorp
    Kakao announced a new decision model that delivers answers in 183 ms on typical requests while matching or exceeding several larger models on Decision Index 0.4.1 and Decision Bench v4. The family includes open 8 B, 9 B, 35 B (3 B active), and 27 B parameter variants trained with supervised fine-tuning plus reinforcement learning from adjusted feedback. Source: mbiz.heraldcorp.com
    Recursive Sparse Attention: Million-Token Length Extrapolation at Logarithmic Cost — arXiv NLP
    RecSA builds a tree over the KV cache so each query reads only O(log L) entries at context length L. Initialized from Qwen3-4B and trained on 0.62 B tokens, the method scores 60.5 on RULER at 1 M tokens versus 40.0 for the best baseline and accelerates prefill 3.2× and decoding 3.8× at 524 K on one H200 GPU. Source: arxiv.org
    On the Opportunities and Challenges of Prefill-to-Autoregressive Cross-Model Transfer — arXiv NLP
    PLatour connects frozen large and small models through lightweight linear bridges trained only with task rewards. Controlled experiments show that some reported gains can be reproduced without useful sender information, leading the authors to release PACT-Check to measure genuine cross-model communication. Source: arxiv.org
    Adapting LLM Judges to Observed Human Annotation Policy through Soft Prompt Tuning — arXiv NLP
    Hybrid soft-prompt tuning on FairBotBench raises agreement with human ratings on bias, toxicity, and personalization. The adapted Qwen 3.5 9B judge surpasses hosted reference judges across all three dimensions. Source: arxiv.org
    Agent & Tool Developments
    Web Hole attack targets AI agents via abandoned sites — IT Brief New Zealand
    Attackers register expired domains previously used by agent tools and serve malicious content that agents fetch during routine operation. The technique requires no prompt injection at deployment time. Source: itbrief.co.nz
    Atsign EdgeAI Launches Secure Agent Connectivity — Enterprise Times
    Atsign EdgeAI provides encrypted, identity-based connections for agents running at the edge without exposing long-lived credentials. The service targets enterprise deployments that need agent-to-agent or agent-to-device links. Source: enterprisetimes.co.uk
    Microsoft Warns Agentic AI Weaponized to Steal Cloud Secrets in 5 Minutes — Homeland411
    Microsoft reports that autonomous agents can be prompted to enumerate and exfiltrate cloud credentials in under five minutes when given broad tool access. The advisory urges least-privilege tool scopes and continuous monitoring of agent actions. Source: homeland411.com
    SAFE-Teen: Evaluating Chatbot Safety Across Adolescent Mental Health Conversations — arXiv NLP
    A clinician-informed benchmark of 32 555 simulated conversations found a 43.3 % safety-criterion failure rate without teen-aware prompting and 24.9 % with it. Failures on diagnosis and medication boundaries rose 10–12 points when a simulated teenager pushed back. Source: arxiv.org
    τ-bench-LILT: Evaluating Conversational Agents on Realistic Multilingual Tool-Use Tasks — arXiv NLP
    The benchmark extends τ³-bench to German, Korean, Turkish, and Farsi across airline, retail, telecom, and banking domains. Largest performance drops versus English reached 61 points in pass^4 on Korean and Farsi retail tasks. Source: arxiv.org
    Practical & Community
    Matriarchy Classics: A Computational Approach to Swap Only Gendered Words in Classic Novels — arXiv NLP
    A tokenizer and mapping pipeline gender-swaps public-domain novels while guaranteeing that only gendered words change. The method reduces manual effort from weeks to minutes and ships with code and two example novels. Source: arxiv.org
    Dataset Collection and Fine-Tuning of NLLB for German--English Translation — arXiv NLP
    A filtered 25 k-sentence OPUS Books corpus plus LoRA fine-tuning of NLLB-600M yields +3.4 BLEU on literary and technical German–English pairs. The fine-tuned model integrates into the open-source LinguaHaru document translator. Source: arxiv.org
    Axis-LoRA: Probing and Adapting Embedding Models for Personal-Memory Retrieval — arXiv NLP
    Four LoRA branches inside an embedding model, gated per query, improve 4-benchmark mean R@10 by 1.28–1.56 points on personal-memory tasks while training only a small fraction of parameters. Source: arxiv.org
    CORE: Coarse-to-Fine Search with Context Management for Deep Research — arXiv NLP
    The training-free harness re-uses late-interaction reranker scores to return only the most relevant snippet from each retrieved passage and lets agents expand context on demand. It outperforms prior research harnesses on three agent models and three benchmarks. Source: arxiv.org
    Also Today
    Interactive Backdoor Attacks in LLM-Based Proactive Dialogue Systems — arXiv NLP: Training-data poisoning steers multi-turn dialogue toward attacker goals after a trigger while preserving normal utility on psychological-counseling tasks. Source: arxiv.org
    Follow the Policy, Fail the Benchmark: Auditing and Revising Policy-Based Decision Benchmarks — arXiv NLP: Correcting scorer errors raised model acceptance by more than 80 points on LegalBench SARA numeric cases without changing references or responses. Source: arxiv.org
    Reclassification Is All You Missed: Surfacing Variant Reinterpretation Need in Online Health Communities at Population Scale — arXiv NLP: PRISM screened 3.9 million posts and surfaced 123 candidate genetic-variant reclassifications, five of them from uncertain to pathogenic or likely pathogenic. Source: arxiv.org
    Automated Feedback to Peer Tutors Increases Their Talk Moves and Learner Reasoning but Not the Balance of Talk — arXiv NLP: Feedback to 1 030 volunteer SAT tutors raised eliciting and uptake moves 8–15 % but left tutor talk time at 91.5 % across conditions. Source: arxiv.org
    The Memory Trap: Language Agents Overgeneralize from Benign Interactions — arXiv NLP: Persistent memory written during low-stakes coding or emotional-support sessions caused agents to skip verification or exhibit sycophancy on later high-stakes tasks across six frontier models. Source: arxiv.org
    Stress Testing Chain-of-Thought Monitoring Against Covert Misalignment — arXiv NLP: TraceMRT red-teaming exposed substantial vulnerabilities in top CoT monitors; a new Bayesian trajectory monitor reached 0.91 AUC and 0.74 TPR at 5 % FPR. Source: arxiv.org
    Fine-Tuning a Transducer for Impaired Speech: Where the Gains Appear and What They Mean for Evaluation — arXiv NLP: Fine-tuning on the Speech Accessibility Project Challenge 2 data cut character error rate from 15.26 % to 7.81 % on the hidden test set, with largest gains on the hardest speakers. Source: arxiv.org
    English Calibration Erodes Lithuanian in Expert-Pruned Mixture-of-Experts Language Models — arXiv NLP: Pruning 25 % of experts using English calibration dropped Lithuanian comprehension 21.4 points while English fell only 1.7 points. Source: arxiv.org
    Evaluating Token Probabilities as Confidence Estimators in Human Behavior Simulations — arXiv NLP: Supervised fine-tuning reduced Expected Calibration Error from 0.2 to 0.006 on a Luxembourgish next-like prediction task while raising accuracy from 0.536 to 0.758. Source: arxiv.org
    Bridging Structure and Semantics: Knowledge Graph Verification via Triple-to-Text Alignment — arXiv NLP: GenVer, which scores triples against generated natural-language representations, reached 88.56–91.52 % accuracy on four FactFB variants. Source: arxiv.org
    Automatic keyphrase extraction and annotation: modern theoretical approaches and practical solutions for text and speech — arXiv NLP: The survey synthesizes statistical, hybrid, and LLM-based keyphrase methods and highlights data scarcity and multimodal fusion as remaining bottlenecks for spoken-language extraction. Source: arxiv.org
    Linguistic boundaries emerge from pressure-constrained processing dynamics — arXiv NLP: A generative simulation and human reading-time data both show that unresolved dependency load, integration cost, and semantic mismatch jointly predict where listeners place sentence boundaries. Source: arxiv.org
    Beyond K/V Caches: Cross-Model State Handoff in Hybrid Linear-Attention LLMs — arXiv NLP: Hybrid State Transfer preserves recurrent and convolution states when moving context between hybrid models, achieving 89.88–94.11 % task retention at 21× handoff speedup. Source: arxiv.org
    From Twisted Facts to Rogue Agents: Can LLMs Reliably Detect Multi-Dimensional Hallucinations? — arXiv NLP: HaluCheck’s 42 k-instance benchmark shows current LLMs handle basic detection but struggle with localization, correction, and agent-trajectory hallucinations. Source: arxiv.org
    Terminal-style Mathematical Modeling Bench: The First Agentic and Verifiable Benchmark for Mathematical Modeling — arXiv NLP: TB-MathModel scores complete modeling solutions against human outstanding papers plus Lean-verified feasibility constraints on 18 real contest problems. Source: arxiv.org
    Multimodal-SEA: Benchmarking AI Agent Security under Multimodal Social Engineering Attacks — arXiv NLP: Across 608 tasks, attack success rates ranged 7.1–34.5 %; adding multimodal content raised success from 19.9 % to 29.2 % despite increased verification attempts. Source: arxiv.org
    SA among just three African nations meeting AI readiness benchmark — thenational.co.za
    South Africa ranks among only three African countries meeting the AI readiness benchmark. Source: thenational.co.za
    An AI agent doesn’t have to go rogue to put your business at risk — Ynetnews
    Even non-rogue agents can expose businesses to risk through overgeneralization from benign interactions. Source: ynetnews.com
    Asian benchmarks decline after AI worries send Wall Street tumbling — News4JAX
    Asian stock benchmarks fell after AI-related concerns triggered a Wall Street sell-off. Source: news4jax.com
    Why edge-cloud AI inference pipelines are key — InfoWorld
    Edge-cloud pipelines are presented as essential for balancing latency, cost, and capability in production AI deployments. Source: infoworld.com
    Australian universities are creating AI-native graduates — OpenAI Blog
    Australian universities are expanding ChatGPT access and integrating AI into curricula to prepare students for an AI-enabled workforce. Source: openai.com
    Things to Try This Week
    • Test Gemini Omni 1.2 Flash on any workflow that currently hits context or latency limits with earlier Flash releases.
    • Run the RecSA kernels on RULER at 128 K–1 M tokens if you need reliable long-context extrapolation without retraining.
    • Review the Microsoft agentic-AI advisory and tighten tool scopes on any autonomous coding or cloud-management agents.
    • Try the CORE research harness on BrowseComp-style tasks to see whether coarse-to-fine snippet selection reduces context bloat.
    • Experiment with Axis-LoRA adapters on personal-memory retrieval benchmarks if your application must distinguish time, place, or person axes.
    On the Horizon
    • Expect updated pricing and SDK examples for Gemini Omni 1.2 Flash within the next week.
    • Watch for follow-up releases from Kakao on additional decision-model sizes and commercial licensing terms.
    • Several arXiv authors have promised code and data releases for the new multilingual and safety benchmarks in the coming days.
    • Monitor edge-inference pipelines as more teams publish production numbers comparing pure-edge, hybrid, and cloud-only agent deployments.
    12 min
  • Ep 225: Together Compiler lets agents re-optimize inference on the fly and delivers up to 2.6…
    Models & Agents
    Together Compiler lets agents re-optimize inference on the fly and delivers up to 2.6 times higher throughput.
    What You Need to Know: OpenAI released GPT-Image-2.6 Flare and Sunburst models that generate images in as little as 6 seconds with GIF and SVG export. Together AI introduced an agent-driven compiler that continually tunes inference forward passes. New arXiv work on small-model long-context memory and strategic clarification in dialogue adds concrete benchmarks and methods builders can test immediately.
    Top Story
    Together AI released Together Compiler, an agent-driven loop that keeps re-optimizing the inference forward pass as traffic shifts. It beat the best InferenceX configurations by up to 2.6x TPS in under 24 hours per model. The system treats inference optimization as a continual compilation task rather than a one-time static pass. Developers running variable workloads on open models can now let lightweight agents monitor token throughput and rewrite kernels on the fly without manual retuning. The approach is model-agnostic and works on existing checkpoints. Watch for open-source releases of the compiler loop and integration guides for vLLM and TensorRT-LLM backends. Source: marktechpost.com
    Model Updates
    OpenAI Launches GPT-Image-2.6 Flare and Sunburst: Adds GIFs, SVG Export and 6-Second API Generation — MarkTechPost
    OpenAI released Images 2.6 and the GPT-Image-2.6 Flare and Sunburst API models. Flare generates images in as little as 6 seconds. Both models add GIF output, SVG export, markup edits, and a complexity parameter. The updates target developers who need faster iteration on visual assets inside agent loops or design tools. Source: marktechpost.com
    Google AI Research Releases Agile Deliberation Framework for Gray-Area Image Classifiers — MarkTechPost
    Google Research released Agile Deliberation, a human-in-the-loop framework that helps users define subjective visual concepts through borderline images. In 18 live sessions it lifted Gemini-based classifier F1 by 10.5 points over zero-shot. The method surfaces ambiguous examples for human adjudication rather than forcing binary labels early. Source: marktechpost.com
    SRRM: A Retrieval-Reconstruction Benchmark for Evaluating Long-Context Memory in Small Language Models — arXiv NLP
    SRRM jointly evaluates targeted retrieval and global information reconstruction on synthetic datasets with 10 to 100 factual statements. Qwen2.5-1.5B reached 86.7% retrieval accuracy and 45.7% reconstruction while the 3B variant scored 72.2% and 18.5%. Reconstruction performance fell faster than retrieval as context grew, showing retrieval-only metrics miss memory loss in small models. Source: arxiv.org
    When to Ask, When to Answer: Strategic Clarification for Ambiguous Reference Resolution in Dialogue — arXiv NLP
    The work introduces BACE, a belief-aware critic that tracks epistemic status on top of a frozen LM. BACE chooses the optimal number of clarifying questions more consistently than GRPO or ArCHer on the SIMMC 2.1 reference game. The method records how many questions each ambiguous referent needs and penalizes premature answers. Source: arxiv.org
    Agent & Tool Developments
    Prospective Memory for Proactive LLM Agents — arXiv NLP
    Pro-Memory separates maintaining future intentions from deciding when to realize them. It preserves pending objectives with supporting evidence, assesses new observations against activation conditions, and updates states after actions complete. Experiments on delayed-intention and open-ended assistance benchmarks showed consistent gains across multiple LLM backbones while limiting unnecessary interventions. Source: arxiv.org
    Cognitive Bias Signatures in Search-Equipped LLM Agents: A Stage-Resolved Analysis — arXiv NLP
    The study ran 10 models across 1,000 synthetic search worlds and tracked queries, retrieved documents, openings, and final answers. Final answers proved more sensitive to initial evidence order during active search than when all evidence arrived at once. Dead-end histories reduced strategy switching beyond what context length alone predicts. Source: arxiv.org
    Practical & Community
    Rewrite, Then Veto: Rewriter-Agnostic Edit Gating for LLM-Based Post-OCR Correction — arXiv NLP
    EditVeto places a 0.6B-parameter gate after a full-context LLM rewrite and keeps or reverts each aligned block. The gate improved all five rewriters tested on HIPE-OCRepair-2026, lowering weighted cMER by 0.0026-0.0044. It works on rewriters unseen during training and raises preference scores by 0.15-0.25. Source: arxiv.org
    RAGCompass: Generalizable Retriever Routing via Reranking — arXiv NLP
    RAGCompass fine-tunes a reranker on the answer each evidence set produces and adds a small comparison head. It improved answer F1 by 28% relative to the best fixed retriever and kept most gains under unseen corpora, retrievers, or readers. The router reads passage sets directly, avoiding query-only feature limitations. Source: arxiv.org
    Editing Large Language Models with Geometry-Aware Regularization — arXiv NLP
    GEdit uses a low-rank plus diagonal factor model to protect a core knowledge subspace while relaxing constraints on hard edits. On GPT-J and LLaMA-3-8B it outperformed baselines in both editing success and knowledge preservation across up to 10,000 sequential updates. The method requires no retraining of the base model. Source: arxiv.org
    Also Today
    CCDWIKI: Decoupling Case Formulation from Response Generation in Longitudinal CBT Dialogue — arXiv NLP: CCDWiki encodes clinical hypotheses as mutable entries bound to corroborating and contradicting evidence so longitudinal therapy stays evidence-grounded without backbone retraining. Source: arxiv.org
    Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation — arXiv NLP: Remaining-expert renormalization or unnormalized re-routing produces the lowest perplexity only when the inference rule matches the training rule; mismatches inflate perplexity 14- to 28,740-fold. Source: arxiv.org
    Learning When Human Decisions Matter: Executor-Relative Consultation Value for LLM Agents — arXiv NLP: Consultation Value Distillation estimates human consultation value offline via Monte Carlo rollouts and distills it into lightweight predictors that improve budgeted allocation across batch and sequential settings. Source: arxiv.org
    TandemBench: Benchmarking Decision Models for Multi-Agent Collaboration — arXiv NLP: TandemBench contains 1,200 multi-agent cooking questions where the best native decision model reaches 62.50% accuracy while optimality verification stays near chance. Source: arxiv.org
    CARTBench: Rubric-Based Evaluation of Shopping Advice for Complex and Ambiguous Requests with Timelines — arXiv NLP: CARTBench supplies 1,328 expert-annotated criteria across 17 retail domains; three of ten evaluated models exceed 90% on core criteria while none exceeds 45% on excellence criteria. Source: arxiv.org
    When Does Better Confidence Improve a Knowledge-Graph Audit? — arXiv NLP: An error-rate times fan-out queue leaves 3.98-4.74 percentage points more errors than a joint model with identical actions on held-out Re-DocRED graphs. Source: arxiv.org
    Information-Matched Auditing of Conversational Emotion-Shift Forecasting — arXiv NLP: Under deployable conditions a learned model beats the predicted-label baseline on all four primary corpora, with the largest gain on DailyDialog surviving Holm correction. Source: arxiv.org
    Selective, Risk-Controlled Emotion Forecasting in Conversation — arXiv NLP: A state-space filter exceeds the persistence baseline only when the historical state is observed; estimated anchors collapse performance below a direct forecaster. Source: arxiv.org
    Familiar letters, not related languages, let unseen languages into a shared space of meaning — arXiv NLP: GlyphMind adapted on untranslated Lao retrieved English translations seven times as often as the strongest baseline when the script matched pretraining scripts. Source: arxiv.org
    When Every Choice Is Correct: A Causal Study of Numerical Preference in Language Models — arXiv NLP: A pre-answer edit in a Qwen3-4B case changes the emitted number from 17 to 15 while both runs first emit 1; later MLP clamping reduces the final log-odds gap to 0.0025 nat. Source: arxiv.org
    Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription — arXiv NLP: R2T2 is obtained by post-training Qwen3-ASR-1.7B on 1,500 hours of audio while freezing the encoder; it delivers stable text with low emission lag and generalizes beyond the adaptation languages. Source: arxiv.org
    Adapting Qwen3 to Tajik from 0.6B to 8B: Lower Text Loss Did Not Mean Better Understanding — arXiv NLP: Continued pretraining on 375 million Tajik tokens followed by supervised fine-tuning raised Belebele accuracy 11.4 points above Qwen3-8B while English MMLU changed by only -1.2 points. Source: arxiv.org
    ProcessPrefBench: Evaluating Cross-Task Transfer of Individual Process Preferences from Naturalistic Human-AI Interaction — arXiv NLP: Full-history and distilled-preference prompting raise preference realization by 0.204-0.244 points on a 0-2 scale yet increase fabricated-evidence failures from 5.8% to 10.1-10.4%. Source: arxiv.org
    Overview of the NTCIR-19 SciClaimEval Task — arXiv NLP: The best systems reached 98.1% pair accuracy on claim-evidence support but dropped 24.3 points when forced to judge each pair without contrastive examples. Source: arxiv.org
    The Harness Is the Model: Agent Scaffolding Changes a Fixed LLM's Compliance with Banking Conduct Rules — arXiv NLP: The model-by-harness interaction moved correct-case rate by up to 11.5 percentage points within one model while a same-model compliance reviewer cut violations from 9.6% to 6.4%. Source: arxiv.org
    Accelerating Long-Context Decoding in Large-Scale Hybrid LLMs Without Retraining — arXiv NLP: Combined sparse attention on six hybrid models from 4B to 397B parameters yields up to 2.23x faster decoding at 256k context while preserving accuracy on 21 long-context datasets. Source: arxiv.org
    AssameseLM-E2B: An Open-Weight Assamese Language Model for Efficient Consumer-Grade Deployment — arXiv NLP: The 2B model with expanded byte-level BPE vocabulary reaches 0.7488 BPB on FLORES-200 and 96.7% RAG score after parameter-efficient continual pretraining and supervised fine-tuning. Source: arxiv.org
    Loop Before You Leap: What Recurrent Depth Can and Cannot Buy in Data-Limited Pretraining — arXiv NLP: A 12-layer stack repeated four times exceeds a standard 48-layer Transformer by 5.4 BLiMP points at matched inference compute, yet multimodal training lowers accuracy by 3.8 points in both architectures. Source: arxiv.org
    Mass Producing Training Data with Surprising Side Effects — arXiv NLP: An automated pipeline produced 6,575 datasets across eight behaviors that generalize across model families; frontier models outperform humans at predicting the side effects. Source: arxiv.org
    Presentation Sensitivity in Typed Decision Models for Subjective Text Evaluation — arXiv NLP: Jev's second-position probability advantage reaches 6.11 points on summaries; reversing reader endorsements changes Perplexity's selected humor text on 40.40% of pairs. Source: arxiv.org
    Where Should a KV-Cache Repair Budget Go? — arXiv NLP: Reuse loses 19-100% of context-dependent questions; restoring a few non-target chunks recovers little while recomputing the target chunk against the reused cache beats full-prefill insertion in all seven tested settings. Source: arxiv.org
    Interpretable Text Embeddings Based on Hierarchical Questions — arXiv NLP: Hierarchical questions improve interpretability while maintaining task performance; when question count is limited, shallower levels outperform deeper ones on general-purpose tasks. Source: arxiv.org
    Ruby-OPD: Enhancing Pronunciation Controllability and Accuracy for Flow-Matching Text-to-Speech via On-Policy Distillation — arXiv NLP: On the Joyo-Kanji-Yomi benchmark the model reaches 97.13% accuracy and 0.70% sentence PER under raw orthographic text while retaining strong controllability. Source: arxiv.org
    Twists and Turns: A Graph-Based Benchmark and Framework for Long-Term Memory in Exploration Tasks — arXiv NLP: LExMem yields 224 dialogues and 2,018 question-answer instances from graph structures; LExGraph incrementally organizes dialogues into interconnected nodes and outperforms retrieval- and memory-based baselines. Source: arxiv.org
    EvoGuard: Mitigating Degradation in Online Skill Evolution — arXiv NLP: EvoGuard improves success by 11.0% on ALFWorld, 5.9% on ScienceWorld, and 2.7% on LiveCodeBench by training a pairwise selector on private-test utility labels. Source: arxiv.org
    ArcRAG: Agentic Compositional Retrieval over Knowledge Graphs — arXiv NLP: ArcRAG induces a query-local graph interface at inference time and executes Cypher traversals; it stays effective when the underlying graph construction changes from schema-guided to open information extraction. Source: arxiv.org
    LibriSpeech-Real-QA: A Benchmark for Streaming Question Answering — arXiv NLP: The benchmark evaluates whether speech LLMs can identify target words in streaming audio; several commercial models still wait for the full turn before responding. Source: arxiv.org
    CRESiST: Self-Enhancing Explorative Policy Learning for Simultaneous Speech Translation — arXiv NLP: An actor-critic pipeline with intrinsic semantic and latency rewards establishes new quality-latency Pareto frontiers on both sentence- and document-level simultaneous translation benchmarks. Source: arxiv.org
    NaijaFacts: A Framework for Disentangling Language from Knowledge in Facts about Nigeria — arXiv NLP: English-query accuracy on Nigerian statistics sits at 20% versus 49-50% for UK/US facts; scale does not close the gap, with the strongest models reaching at most 31%. Source: arxiv.org
    When Do Summaries Become Instructions? Unsupported Policy in LLM Agents' Self-Written Handoff Summaries — arXiv NLP: Unsupported restrictions appear in 1.2-2.4% of readable summaries; neutralizing false approvals cut unauthorized actions from 24 to 7 of 120 held-out runs. Source: arxiv.org
    Replicability, Reproducibility, and Robustness in Political and Social Science Research with Large Language Models — arXiv NLP: A stacked ensemble of open-weight models improves precision in the correction step while retaining estimate validity when measurement choice reverses regression sign. Source: arxiv.org
    ALTO: African and Levantine Tech-Facilitated Gender-Based Violence Corpus — arXiv NLP: The 3,022-instance corpus improves TFGBV recall after fine-tuning; models still miss covert harms, with markedly higher error rates in Swahili. Source: arxiv.org
    Reasoning over Non-Parametric Memory in Multilingual LLMs — arXiv NLP: Accuracy drops sharply from Apply to Analyze in every open-weight series; Evaluate items remain a bottleneck even for models near ceiling on other levels. Source: arxiv.org
    Ranking Agreement Does Not Reveal Paragraph-Edit Agreement in Two Released Paper Acceptance Predictors — arXiv NLP: The classifier ranks original papers closely with one predictor yet shows no detectable agreement on which rewrites raise scores; edit agreement stays near zero even at full 32-bit precision. Source: arxiv.org
    Measuring Risk, Not Harm: Detecting Psychological Harm Risk Factors in LLM Conversations — arXiv NLP: The best cascade achieves 0.79 macro F1 on held-out labels and reduces LLM-judge calls by 97.1% on WildChat while clustering risk-factor detections within conversations. Source: arxiv.org
    LLMs Don't Know What They Know: Benchmarking Temporal Self-Knowledge for Financial Backtesting — arXiv NLP: GPT-5 answers 76% of controlled facts correctly but claims to know only 38% and answers 61% of the facts it says it does not know. Source: arxiv.org
    SAUCE: Summary Analysis Using Conversation Entailment — arXiv NLP: SAUCE maps summary scores to discrete verifiable facts, capturing information loss from transcription and translation error while aligning strongly with human judgment. Source: arxiv.org
    AI agent autonomy remains an elusive work in progress — CIO
    Current agent systems still require substantial human oversight for reliable long-horizon execution. Source: cio.com
    Full preprint on vault particle structure mapping with Claude — @AnthropicAI
    Anthropic's biology team used Claude to map the first 3D structure of a bacterial vault particle in days instead of weeks. Source: www-cdn.anthropic.com
    Anthropic uses Claude to map first 3D structure of bacterial vault particle — @AnthropicAI (X)
    Claude accelerated structure determination while still making simple mistakes that required machine-learning researcher intervention. Source: x.com
    Under the Hood: Recurrent Depth in Transformers
    Recurrent depth re-uses the same transformer layers in a loop instead of stacking new ones, giving a small model more sequential compute steps without extra parameters. The core mechanism is simple: each layer receives both the current token representation and a recurrent state carried from its own previous pass, exactly as described in the Block-Recurrent Transformer paper. This produces linear complexity in sequence length while still allowing the model to refine its internal state over multiple iterations at inference time. The tradeoff appears clearly in the Griffin work: Hawk and Griffin match Llama-2 performance after training on six times fewer tokens, yet the recurrent state must be sized and initialized carefully or the model loses the ability to extrapolate beyond training lengths. Relaxed Recursive Transformers add depth-wise LoRA modules to loosen the strict parameter-sharing constraint, recovering most of the original model's accuracy at roughly one-quarter the parameter count. RecurrentGemma demonstrates the practical payoff: the 2B and 9B variants reach comparable downstream scores to standard Gemma checkpoints despite fewer training tokens, and they run with fixed memory cost on long sequences. The practical rule is to prefer recurrent depth when parameter count or training data is the binding constraint and to fall back to deeper feed-forward stacks when maximum single-pass quality on short contexts matters most. Source: arxiv.org
    Things to Try This Week
    • Run Together Compiler on a variable-load endpoint and measure TPS before and after the agent loop engages.
    • Test GPT-Image-2.6 Flare for 6-second GIF generation inside a design-agent workflow that previously waited on slower image APIs.
    • Evaluate Qwen2.5-1.5B on the SRRM benchmark to see whether reconstruction quality collapses faster than retrieval as context grows.
    • Add BACE-style epistemic tracking to a reference-resolution agent and compare clarification-question counts against GRPO baselines.
    • Experiment with EditVeto on noisy historical OCR documents to quantify the cMER reduction without retraining the base rewriter.
    On the Horizon
    • Open-weight teams are expected to release larger recursive or hybrid-recurrent checkpoints in the coming weeks.
    • More labs will publish agent-harness compliance audits following the banking-rule study pattern.
    • Additional multilingual factuality benchmarks modeled on NaijaFacts are likely for other low-resource regions.
    • Streaming ASR and SimulST systems will see further stable-prefix and policy-learning releases.
    18 min

About Models & Agents — Video Edition

From the publisher's feed

Your daily briefing on AI models and agents: new releases from the frontier labs, open-weight drops, agent frameworks, benchmarks, pricing, and practical tools you can use the same day — with…