GenAI Learner

A new system from Microsoft Research shows how EvoTest evolves an agent's entire configuration using narrative transcript analysis, outperforming gradient-based and reflection methods.

An individual's DreamCoder-inspired method proved to be the most performance-cost efficient approach to the complex ARC-AGI Prize challenge.

Original Article: https://substack.com/home/post/p-172998849 

Understand the details with our non-technical explanation on GenAI Learner.

Jeremy Berman's Substack reveals a state-of-the-art 79.6% ARC-AGI score by using an evolutionary process that refines plain English instructions instead of code—tune into GenAI learner for a simple breakdown.

Hear how Anthropic's Sonnet 3.5 smashed the ARC-AGI record by using Evolutionary Test-time Compute to overcome generalization limits. 

Substack: https://jeremyberman.substack.com/p/how-i-got-a-record-536-on-arc-agi 

Get the simple breakdown on the GenAI learner podcast.

Google, Inc.'s François Chollet argues that we should stop measuring AI's performance and start measuring intelligence as the efficiency of skill acquisition over a range of tasks, accounting for priors and experience. 

Arxiv: https://arxiv.org/abs/1911.01547 

Get the simple breakdown on "GenAI learner."

The ARC Prize Foundation just dropped ARC-AGI-2, a new, harder AI benchmark designed to assess general fluid intelligence at higher cognitive complexity levels. 

Arxiv:  https://arxiv.org/abs/2505.11831 

Tune into GenAI learner for the simple breakdown of why it's so challenging for modern AI.

ARC Prize 2024 revealed that Test-Time Training (TTT) and program synthesis drove the state-of-the-art ARC-AGI score from 33% to 55.5%. 

Arxiv: https://arxiv.org/abs/2412.04604 

Tune into GenAI Learner for a simple, non-technical explanation of this breakthrough and what it means for AGI progress.

Researchers from Tencent and Renmin University of China discovered the reasoning reward equals a last-token self-rewarding score, a game-changer for efficient LLM verification—get the simple breakdown on GenAI Learner.

Wonder why LLMs struggle with multi-step logic? A new paper from MBZUAI shows the Fano-style accuracy upper bound proves single-pass LLM reasoning collapses when task complexity exceeds output capacity.

Engineers from ByteDance and Carnegie Mellon University just scaled LLM agents 10x with Context-Folding, a method that summarizes complex sub-tasks to manage memory.