
Sign up to save your podcasts
Or
While you can make a lot of progress in evals with tinkering and paying little attention to the literature, we found that various other papers have saved us many months of research effort. The Apollo Research evals team thus compiled a list of what we felt were important evals-related papers. We likely missed some relevant papers, and our recommendations reflect our personal opinions.
Our favorite papers
---
Outline:
(00:29) Our favorite papers
(03:20) Other evals-related publications
(03:25) LM agents
(05:58) Benchmarks
(09:05) Science of evals
(12:02) Software
(13:03) Miscellaneous
(16:49) Related papers from other fields
(16:53) Red teaming
(18:13) Scalable oversight
(19:28) Scaling laws and emergent behaviors
(21:45) Science tutorials
(23:20) LLM capabilities
(25:15) LLM steering
(28:52) Fairness, bias, and accountability
(29:48) AI Governance
(32:31) Contributions
---
First published:
Source:
Narrated by TYPE III AUDIO.
While you can make a lot of progress in evals with tinkering and paying little attention to the literature, we found that various other papers have saved us many months of research effort. The Apollo Research evals team thus compiled a list of what we felt were important evals-related papers. We likely missed some relevant papers, and our recommendations reflect our personal opinions.
Our favorite papers
---
Outline:
(00:29) Our favorite papers
(03:20) Other evals-related publications
(03:25) LM agents
(05:58) Benchmarks
(09:05) Science of evals
(12:02) Software
(13:03) Miscellaneous
(16:49) Related papers from other fields
(16:53) Red teaming
(18:13) Scalable oversight
(19:28) Scaling laws and emergent behaviors
(21:45) Science tutorials
(23:20) LLM capabilities
(25:15) LLM steering
(28:52) Fairness, bias, and accountability
(29:48) AI Governance
(32:31) Contributions
---
First published:
Source:
Narrated by TYPE III AUDIO.
26,370 Listeners
2,386 Listeners
7,925 Listeners
4,134 Listeners
87 Listeners
1,456 Listeners
9,048 Listeners
87 Listeners
387 Listeners
5,420 Listeners
15,207 Listeners
472 Listeners
120 Listeners
75 Listeners
456 Listeners