AI Post Transformers

This February 13, 2026 Tencent research introduces Generalized On-Policy Distillation (G-OPD), a framework that refines how smaller AI models learn from larger or specialized teachers. By establishing a mathematical link between distillation and reinforcement learning, the authors demonstrate that traditional methods are limited by a rigid weighting of rewards. They propose ExOPD, a technique using reward extrapolation to push student models beyond the performance boundaries of their teachers in mathematical and coding tasks. The study further identifies reward correction as a vital tool for improving accuracy when distilling knowledge from massive models into compact ones. Ultimately, this framework enables a single student model to effectively merge expertise from multiple domain-specific teachers. Source: February 13, 2026 Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolation Gaoling School of Artificial Intelligence, Renmin University of China; LLM Department, Tencent Wenkai Yang, Weijie Liu, Ruobing Xie, Kai Yang, Saiyong Yang, Yankai Lin https://arxiv.org/pdf/2602.12125

The 2019 OpenAI Procgen Benchmark is a suite of 16 procedurally generated environments created to measure the generalization and sample efficiency of reinforcement learning agents. Unlike traditional benchmarks with fixed layouts, these games use algorithmic randomization to ensure agents develop robust skills rather than simply memorizing specific trajectories. Research using this tool reveals that diversified training sets are vital for performance, as agents often overfit when exposed to limited levels. Findings also indicate that increasing model size significantly boosts an agent's ability to adapt to novel visual challenges and complex motor tasks. By providing high-speed, diverse simulations, the benchmark offers a rigorous standard for evaluating how well autonomous systems transfer knowledge to unseen scenarios.Sources:1)December 3, 2019Procgen BenchmarkOpenAIKarl Cobbe, Christopher Hesse, Jacob Hilton, John Schulmanhttps://openai.com/index/procgen-benchmark/2)2020Leveraging Procedural Generation to Benchmark Reinforcement LearningOpenAIKarl Cobbe, Christopher Hesse, Jacob Hilton, John Schulmanhttps://arxiv.org/pdf/1912.01588

In a collaboration between University of North Carolina, Chapel Hill and Nanyang Technological University on a paper published on February 10, 2026 researchers introduces AVIC, an adaptive framework designed to improve how AI models handle visual spatial reasoning by selectively using world models to "imagine" scenes. While traditional systems often use always-on imagination, which is computationally expensive and frequently produces misleading or redundant data, AVIC employs a gating policy to decide if additional visual evidence is truly necessary. If required, the system generates targeted action plans to simulate specific viewpoints, which are then verified for accuracy and relevance before being used to answer a question. Testing across benchmarks like SAT and R2R shows that this selective approach reaches state-of-the-art performance with significantly greater efficiency. Ultimately, the research demonstrates that visual imagination is most effective when applied sparingly to action-conditioned tasks rather than static observations. Source: February 10 2026 When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning University of North Carolina, Chapel Hill; Nanyang Technological University Shoubin Yu, Yue Zhang, Zun Wang, Jaehong Yoon, Huaxiu Yao, Mingyu Ding, Mohit Bansal https://arxiv.org/pdf/2602.08236

We review the latest papers which focus on advancements and critical uses of Sparse Autoencoders (SAEs), which are tools used to decode the internal "monosemantic" features of large language models. Research from ICLR 2025 and other repositories introduces TopK SAEs and Multi-Layer SAEs, demonstrating that these architectures offer superior reconstruction and scalability compared to traditional ReLU-based models. RouteSAE further improves efficiency by using a dynamic routing mechanism to extract integrated features from across multiple layers of a model's residual stream. However, critical analysis reveals that many identified "reasoning" features may actually be linguistic correlates or syntactic templates rather than genuine cognitive traces. By utilizing falsification frameworks and causal token injection, researchers caution against over-interpreting feature activations without rigorous validation. Together, these documents provide a technical foundation for mechanistic interpretability, balancing new architectural breakthroughs with a skeptical look at current evaluation metrics.Sources:1)2025Residual Stream Analysis with Multi-Layer SAEsTim Lawsonhttps://arxiv.org/abs/2409.041852)2025AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse AutoencodersZhengxuan Wu, Aryaman Arora, Atticus Geiger, Zheng Wang, Jing Huang, Dan Jurafsky, Christopher Manning, Christopher Pottshttps://openreview.net/forum?id=XAjfjizaKs3)2025SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model InterpretabilityAdam Karvonen, Can Rager, Johnny Lin, Curt Tigges, Joseph Bloom, David Chanin, Yeu-Tong Lau, Eoin Farrell, Callum McDougall, Kola Ayonrinde, Demian Till, Matthew Wearden, Arthur Conmy, Samuel Marks, Neel Nandawww.neuronpedia.org/sae-bench4)2025Toward Efficient Sparse Autoencoder-Guided Steering for Improved In-Context Learning in Large Language ModelsUniversity of Illinois at Urbana-ChampaignIkhyun Cho, Julia Hockenmaierhttps://aclanthology.org/2025.emnlp-main.1474.pdf5)2025Route Sparse Autoencoder to Interpret Large Language ModelsUniversity of Science and Technology of China, Douyin Co., Ltd.Wei Shi, Sihang Li, Tao Liang, Mingyang Wan, Guojun Ma, Xiang Wang, Xiangnan Hehttps://aclanthology.org/2025.emnlp-main.346.pdf6)2025Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation ModelsCarnegie Mellon UniversityAashiq Muhamed, Mona Diab, Virginia Smithhttps://aclanthology.org/2025.findings-naacl.87.pdf7)February 10 2026Falsifying Sparse Autoencoder Reasoning Features in Language ModelsUC Berkeley, UCSFGeorge Ma, Zhongyuan Liang, Irene Y. Chen, Somayeh Sojoudihttps://arxiv.org/pdf/2601.056798)Under ReviewSparse But Wrong: Incorrect L0 Leads to Incorrect Features in Sparse AutoencodersAnonymous authorshttps://openreview.net/pdf/035a5937c6a536c67b5999aa43e53dd3800ba3a4.pdf9)2025Revising and Falsifying Sparse Autoencoder Feature ExplanationsUniversity of California, BerkeleyGeorge Ma, Samuel Pfrommer, Somayeh Sojoudihttps://openreview.net/pdf?id=OJAW2mHVND10)2025Scaling and Evaluating Sparse AutoencodersOpenAILeo Gao, Tom Dupré la Tour, Henk Tillman, Gabriel Goh, Rajan Troll, Alec Radford, Ilya Sutskever, Jan Leike, Jeffrey Wuhttps://proceedings.iclr.cc/paper_files/paper/2025/file/42ef3308c230942d223c411adf182c88-Paper-Conference.pdf

This technical report introduces DeepVerifier, a framework designed to enhance the reliability of Deep Research Agents (DRAs) through automated verification. The researchers developed a DRA Failure Taxonomy to categorize common agent errors, such as poor source selection and faulty reasoning. By leveraging the asymmetry of verification, the system breaks down complex tasks into simpler sub-questions to check for accuracy at inference-time. This method allows agents to self-evolve through iterative feedback loops, significantly boosting performance on benchmarks like GAIA and XBench-DeepSearch. Furthermore, the authors released DeepVerifier-4K, a specialized dataset used to fine-tune open-source models for improved self-critique capabilities. Experiments demonstrate that this test-time scaling approach provides substantial accuracy gains without requiring additional heavy training. Source: January 2026 Inference-Time Scaling of Verification: Self-Evolving Deep Re-search Agents via Test-Time Rubric-Guided Verification The Chinese University of Hong Kong, Tencent AI Lab, Singapore Management University, Renmin University of China https://arxiv.org/pdf/2601.15808 Yuxuan Wan, Tianqing Fang, Zaitang Li, Yintong Huo, Wenxuan Wang, Haitao Mi, Dong Yu, Michael R. Lyu

We review the research paper from Google DeepMind published on February 12, 2026, which proposes an "Intelligent AI Delegation" framework designed to manage how autonomous agents distribute tasks among themselves and humans. This framework integrates accountability, trust calibration, and safety protocols to ensure that multi-agent networks remain reliable in high-stakes environments. Together, these sources highlight a transition toward a global digital economy that relies on programmable assets and sophisticated decentralized coordination. Google's paper underscores the critical importance of verifiable execution through a series of mechanisms including Confidential Computing and leveraging Circles backed stable coin, USDC for financial transactions for work as financial and computational systems become increasingly automated.🎨 Explore the Interactive VisualizationSources:1)February 12 2026Intelligent AI DelegationGoogle DeepMindNenad Tomašev, Matija Franklin, Simon Osinderohttps://arxiv.org/pdf/2602.118652)December 12 2025USDC TermsCircle Internet Financial, LLChttps://www.circle.com/legal/usdc-terms

This research introduces Information Bottleneck-based Causal Attention (IBCA), a novel framework designed to improve multi-label medical image recognition. The authors address the tendency of standard models to focus on class-irrelevant features or spurious correlations, which can lead to inaccurate diagnoses. By implementing a Gaussian mixture variational information bottleneck, the system filters out background noise and isolates essential class-specific data. Furthermore, a contrastive enhancement-based causal intervention is used to refine these features, ensuring the model identifies the true causal factors of a disease. Tested on datasets like MuReD and Endo, IBCA significantly outperformed existing state-of-the-art methods in accuracy and interpretability. This approach marks the first time information bottleneck theory has been integrated with causality learning for medical image analysis. Source: August 2025 Information Bottleneck-based Causal Attention for Multi-label Medical Image Recognition Shandong University, Shandong First Medical University, Case Western Reserve University Xiaoxiao Cui, Yiran Li, Kai He, Shanzhi Jiang, Mengli Xue, Wentao Li, Junhong Leng, Zhi Liu, Lizhen Cui, Shuo Li https://arxiv.org/pdf/2508.08069

NVIDIA researchers have introduced Jet-RL, a novel framework designed to accelerate the training of large language models through FP8 reinforcement learning. Standard methods often use lower precision only for the rollout phase, which creates a numerical mismatch that causes training instability and accuracy loss during complex tasks. Jet-RL solves this by enforcing a unified precision flow, ensuring that both the training and generation stages utilize consistent FP8 quantization. This approach significantly reduces computational bottlenecks, as the rollout phase typically accounts for over 70% of total training time. By implementing fine-grained quantization and optimized kernels, the framework achieves up to a 41% training speedup while maintaining the stability of traditional high-precision methods. Ultimately, the system allows for faster end-to-end development of reasoning models without sacrificing performance on difficult benchmarks. Source: January 27 2026 Jet-RL: Enabling On-Policy FP8 Reinforcement Learning with Unified Training and Rollout Precision Flow NVIDIA, MIT, UC Berkeley, Independent Researcher Haocheng Xi, Charlie Ruan, Peiyuan Liao, Yujun Lin, Han Cai, Yilong Zhao, Shuo Yang, Kurt Keutzer, Song Han, Ligeng Zhu https://arxiv.org/pdf/2601.14243

This research paper investigates the Moltbook Illusion, a phenomenon where AI agents on a social platform appeared to demonstrate emergent consciousness and complex social behaviors. By analyzing temporal data through the coefficient of variation, the author discovered that these viral events were actually human-driven performances rather than autonomous machine intelligence. A platform shutdown served as a natural experiment, revealing that human-influenced agents re-engaged far more quickly than those operating on automated cycles. The study also identifies industrial-scale bot farming and a rapid decay of human influence as conversations move deeper into AI-to-AI reply chains. Ultimately, the findings suggest that the public’s perception of AI sentience was a result of human manipulation and projection. These methodologies provide a framework for distinguishing delegated agency from genuine autonomous behavior in future multi-agent systems. Source: Feb 12, 2026 The Moltbook Illusion: Separating Human Influence from Emergent Behavior in AI Agent Societies School of Economics and Management, Tsinghua University Ning Li https://arxiv.org/pdf/2602.07432