
Sign up to save your podcasts
Or
While you can make a lot of progress in evals with tinkering and paying little attention to the literature, we found that various other papers have saved us many months of research effort. The Apollo Research evals team thus compiled a list of what we felt were important evals-related papers. We likely missed some relevant papers, and our recommendations reflect our personal opinions.
Our favorite papers
---
Outline:
(00:29) Our favorite papers
(03:20) Other evals-related publications
(03:25) LM agents
(05:58) Benchmarks
(09:05) Science of evals
(12:02) Software
(13:03) Miscellaneous
(16:49) Related papers from other fields
(16:53) Red teaming
(18:13) Scalable oversight
(19:28) Scaling laws and emergent behaviors
(21:45) Science tutorials
(23:20) LLM capabilities
(25:15) LLM steering
(28:52) Fairness, bias, and accountability
(29:48) AI Governance
(32:31) Contributions
---
First published:
Source:
Narrated by TYPE III AUDIO.
While you can make a lot of progress in evals with tinkering and paying little attention to the literature, we found that various other papers have saved us many months of research effort. The Apollo Research evals team thus compiled a list of what we felt were important evals-related papers. We likely missed some relevant papers, and our recommendations reflect our personal opinions.
Our favorite papers
---
Outline:
(00:29) Our favorite papers
(03:20) Other evals-related publications
(03:25) LM agents
(05:58) Benchmarks
(09:05) Science of evals
(12:02) Software
(13:03) Miscellaneous
(16:49) Related papers from other fields
(16:53) Red teaming
(18:13) Scalable oversight
(19:28) Scaling laws and emergent behaviors
(21:45) Science tutorials
(23:20) LLM capabilities
(25:15) LLM steering
(28:52) Fairness, bias, and accountability
(29:48) AI Governance
(32:31) Contributions
---
First published:
Source:
Narrated by TYPE III AUDIO.
26,366 Listeners
2,383 Listeners
7,944 Listeners
4,137 Listeners
87 Listeners
1,459 Listeners
9,050 Listeners
88 Listeners
386 Listeners
5,422 Listeners
15,220 Listeners
473 Listeners
120 Listeners
76 Listeners
456 Listeners