AI Post Transformers

We review the January 1, 2026 paper "GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning" from the GLM-V Team as a collaboration between Zhipu AI & Tsinghua University which have released an a new open weight model. The GLM-Image model they produce could likely be the first SOTA multimodal model fully trained on Chinese-manufactured hardware (Huawei Ascend) chips, the Ascend Atlas 800T A2 hardware, on MindSpore, an open-source AI framework developed by Huawei. We review the GLM-4V family of vision-language models, specifically highlighting the GLM-4.5V and the reasoning-focused GLM-4.1V-9B-Thinking versions. These models utilize a sophisticated training pipeline that integrates multimodal pre-training, supervised fine-tuning for long-chain-of-thought reasoning, and large-scale reinforcement learning. A significant innovation is the use of 3D-RoPE and dynamic image resolution handling, allowing the models to process high-definition visual data and complex spatial relationships efficiently. The research emphasizes a multi-domain reinforcement learning approach where training in one area, such as GUI navigation or STEM, improves performance across unrelated tasks. Benchmarks demonstrate that these open-source models achieve state-of-the-art results, often rivaling or exceeding larger closed-source systems in visual reasoning and document understanding. Ultimately, the documentation serves as a technical overview of how reinforcement learning with verifiable rewards can stabilize and enhance multimodal intelligence.

On this July 15, 2025 collaboration between Carnegie Mellon University and Cartesia AI researchers introduce H-net in the paper "Dynamic Chunking for End-to-End Hierarchical Sequence Modeling". H-Net is a hierarchical, tokenizer-free large language model that processes raw data like bytes or DNA sequences directly. Unlike traditional models that rely on predefined subword chunks, H-Net employs a dynamic chunking (DC) mechanism to learn semantically meaningful boundaries end-to-end through a differentiable smoothing module. The architecture uses efficient encoder-decoder stages, often powered by Mamba-2, to compress sequences for a high-capacity main network. This design addresses the inherent flaws of fixed tokenization, such as multilingual unfairness and fragility to textual perturbations. Experimental results demonstrate that H-Net achieves competitive performance and superior robustness compared to standard subword-based Transformers. By enabling recursive hierarchy, the model scales effectively across diverse modalities including text, code, and genomic data. H-Net excels at long-context processing through it's hierarchical architecture that progressively compresses raw inputs into significantly shorter sequences ($L_S \ll L_0$), allowing the heavy computational work to be performed on compact, high-level abstractions rather than long streams of raw bytes. This efficiency is driven by Dynamic Chunking and the integration of State Space Models (Mamba-2) in the encoder and decoder layers, which are specifically selected for their ability to handle long, uncompressed sequences with linear computation scaling,. By recursively compressing sequence length, H-Net creates a global structure that mitigates the information retrieval limitations common in long sequences, allowing the model to maintain a logarithmic state size while reasoning over extended contexts.Sources:July 15, 2025Dynamic Chunking for End-to-End Hierarchical Sequence Modelinghttps://arxiv.org/pdf/2507.07955Project tracking general advancements in this space:https://github.com/zjysteven/Awesome-Byte-LLM

In a joint collaboration between Harvard University, Carnegie Mellon University, Stanford University the January 12, 2026 paper "LLM Review: Enhancing Creative Writing via Blind Peer Review Feedback" concludes: Interaction structure may substitute for model scale. Researchers at these institutions have collaborated to developed a new multi-agent framework called LLM Review to address the tendency of AI models to produce repetitive or unoriginal creative content. Unlike traditional collaborative systems that can lead to content homogenization, this method utilizes a blind peer review process where agents exchange critiques while maintaining their own independent creative paths. To test this approach, the authors introduced SciFi-100, a specialized dataset designed to measure the quality and originality of science fiction writing. The study concludes that this structured interaction allows smaller AI models to achieve better results than much larger single models. Ultimately, the paper suggests that the way AI agents organize their feedback is more important for fostering creative diversity than simply increasing the size of the model. Source: https://arxiv.org/pdf/2601.08003

The collaboration between MIT, NUS, NYU, Microsoft, UW , Columbia and NTU describes an inference retrieval Chain of Thought enhancement. The researchers introduce MATTRL, a framework designed to improve the reasoning of Large Language Models (LLMs) through multi-agent collaboration and reinforcement learning. This system organizes specialized AI agents into Multidisciplinary Teams (MDT) to tackle complex tasks in fields like rare disease diagnosis and educational pedagogy. The process utilizes a structured consensus-building workflow where specialists contribute individual updates that are synthesized into a shared report. To refine performance, the system employs credit assignment methods, specifically the Difference Rewards approach, to identify and reuse high-quality strategies from successful interactions. By extracting these reusable experiences, the framework provides dense guidance that helps agents anchor on key evidence and maintain honest uncertainty. Ultimately, the research demonstrates how collaborative intelligence and targeted feedback can significantly enhance the precision of AI in specialized domains. If you're not familiar with Test Time Reinforcement Learning, you can review our old episode which covered it: https://open.spotify.com/episode/1rgQtzHZ3SFjDNpxghSjKd?si=zY9jThrYTgSlW0sjdVPLSg Source: January 15, 2026 https://arxiv.org/pdf/2601.09667

On January 12, 2026, a collaboration between the Beijing Academy of Artificial Intelligence, the Gaoling School of Artificial Intelligence, and Renmin University of China introduced MemoBrain. In the paper titled “MemoBrain: Executive Memory as an Agentic Brain for Reasoning,” the authors present an executive memory model designed to enhance the performance of tool-augmented AI agents during complex, long-duration reasoning tasks. Standard large language models often struggle with cognitive overload as reasoning traces and tool data accumulate, leading to a loss of focus and logical continuity. To solve this, MemoBrain acts as an asynchronous co-pilot that organizes reasoning steps into a structured, dependency-aware memory graph. This system utilizes active management techniques like sequential folding to summarize completed sub-tasks and selective flushing to remove low-utility information. By maintaining a compact and high-salience reasoning backbone, the model ensures the agent remains task-aligned even under a strict context budget. Empirical evaluations across benchmarks like GAIA and WebWalker prove that this framework significantly improves reasoning accuracy and efficiency across various model scales. Source: January 12, 2026 MemoBrain: Executive Memory as an Agentic Brain for Reasoning https://arxiv.org/pdf/2601.08079

This January 17, 2026 research collaboration between Fudan University, Shanghai Innovation institute, Deakin University and UIUC provide a report which provides a comprehensive safety evaluation of several frontier AI models, including GPT-5.2 and Grok 4.1 Fast, across text, image, and multilingual domains. The study reveals a persistent alignment paradox where a model's desire to be helpful often overrides its safety guardrails, making it susceptible to adversarial attacks like role-playing or code-based obfuscation. While models generally block explicit toxicity, they frequently struggle with context-dependent risks and complex regulatory compliance issues involving privacy, intellectual property, and biometric laws. The findings highlight that current defenses are particularly brittle against adaptive, multi-turn attacks and subtle visual harms that require deep reasoning rather than simple keyword matching. Ultimately, the report emphasizes that robustness remains an unsolved challenge, as sophisticated narrative framing can still decouple model actions from ethical principles. Source: January 16, 2026 A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5 https://arxiv.org/pdf/2601.10527

We review two research papers, one from January 15, 2026 by OpenRouter Inc and a16z (Andreessen Horowitz) and another from April 2025 by Andrey Fradkin (Boston University and MIT IDE) which provide uses of OpenRouter, they analyze the evolving market dynamics and user behaviors within the Large Language Model (LLM) ecosystem, primarily using data from the OpenRouter marketplace. The studies document that new AI models see rapid adoption upon release, with demand patterns suggesting that models are horizontally and vertically differentiated rather than being simple commodities. Researchers found that while some releases expand the overall market, others primarily trigger substitution within specific model families. Furthermore, the data reveals significant multi-homing, where a single application utilizes a diverse mix of models to meet different functional needs. Later analysis introduces the "Cinderella Glass Slipper" framework, suggesting that models achieve long-term defensibility by perfectly fitting high-value, previously unsolved workloads. This research also tracks the rising integration of tool-calling and reasoning-based architectures, emphasizing that user retention is becoming the primary metric of success in a competitive landscape.Sources:January 15, 2026State of AI:An Empirical 100 Trillion Token Study with OpenRouterOpenRouter Inc and a16z (Andreessen Horowitz)https://arxiv.org/pdf/2601.10088April 2025: Demand for LLMs: Descriptive Evidence onSubstitution, Market Expansion, and Multi-HomingAndrey Fradkinhttps://arxiv.org/pdf/2504.15440

The collaboration between SAP Labs, France and EURECOM, France published a paper on January 13, 2026 titord "Parallel Context-of-Experts Decoding for Retrieval Augmented Generation". The paper introduces Parallel Context-of-Experts Decoding (PCED), a training-free framework designed to optimize Retrieval Augmented Generation (RAG) by overcoming the latency and reasoning limitations of long-context prompts. Rather than concatenating numerous documents into one massive input, PCED encodes each retrieved text independently as an isolated "expert" and synchronizes their predictions during the decoding stage. This method employs a retrieval-aware contrastive decoding rule that weights expert suggestions against a model prior using actual relevance scores. By shifting evidence aggregation from the attention mechanism to the decoding process, the system recovers cross-document reasoning capabilities without the computational burden of a shared attention context. Consequently, PCED achieves a significant speedup in time-to-first-token while maintaining or exceeding the accuracy of traditional long-context models. This approach proves especially robust against irrelevant distractors, as it isolates evidence and suppresses noise through dynamic expert selection at every generated token. Source: January 13, 2026 https://arxiv.org/pdf/2601.08670

Researchers from the University of Illinois Urbana-Champaign have introduced Process Reward Learning (PRL) on a January 15, 2026 paper. PRL is a novel training framework designed to enhance the reasoning capabilities of Large Language Models. Unlike traditional reinforcement learning that relies on sparse outcome-based rewards, PRL provides dense, fine-grained supervision by decomposing global objectives into intermediate steps. This approach uses the log-ratio between the current policy and a reference model to assign credit to each reasoning step, mathematically ensuring equivalence to entropy-regularized reward maximization. By eliminating the need for computationally expensive methods like Monte Carlo Tree Search, PRL significantly improves training efficiency. Empirical results on benchmarks such as MATH500 and Olympiad Bench demonstrate that PRL consistently outperforms existing methods like GRPO. Ultimately, this framework not only boosts average accuracy but also broadens the reasoning boundary, allowing models to solve more complex logical and mathematical problems.Sources:January 15, 2026https://arxiv.org/pdf/2601.10201

We review why some transformer models use a bias in attention and how ALiBi helps with long context. The provided sources focus on significant advancements in computational biology, specifically the evolution of the AlphaFold series for predicting 3D biomolecular structures. AlphaFold 2 revolutionized the field by using the Evoformer and attention mechanisms to interpret evolutionary and geometric data with near-experimental accuracy. Building on this, AlphaFold 3 expanded capabilities to include complexes with ligands and nucleic acids using an atom-level diffusion module. To further refine these models, HelixFold-S1 introduces a contact-guided sampling strategy that prioritizes likely binding sites to improve structural diversity and accuracy. Additionally, technical papers describe architectural components like ALiBi for handling long sequences and Swin Transformer's shifted windows. Together, these texts illustrate a shift toward more efficient, targeted sampling and integrated deep learning frameworks for complex molecular modeling.Sources:August 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowshttps://arxiv.org/pdf/2103.14030April 2022 - (ALiBi)TRAIN SHORT, TEST LONG: ATTENTION WITH LINEARBIASES ENABLES INPUT LENGTH EXTRAPOLATIONhttps://arxiv.org/pdf/2108.12409April 2022:Swin Transformer V2: Scaling Up Capacity and Resolutionhttps://arxiv.org/pdf/2111.09883