Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Takeaways from a survey on AI alignment resources, published by DanielFilan on November 5, 2022 on LessWrong.
What am I talking about?
In June and July of this year, I ran a survey to ask a lot of people how useful they found a variety of resources on AI alignment. I was particularly interested in “secondary resources”: that is, not primary resource outputs, but resources that summarize, discuss, analyze, or propose concrete research efforts. I had many people promote the survey in an attempt to make it not obvious that I was running it (so that it would not affect what people said about AXRP, the podcast that I run). CEA helped a great deal with the shaping and promotion of the survey.
The goal of the survey was initially to figure out how useful AXRP was, but I decided that it would be useful to get a broader look at the space of these secondary resources. My hope is that the results give people a better sense of what secondary resources might be worth checking out, as well as gaps that could be filled.
Participants were shown a list of resources, select those they’d engaged with for >30 min, and for each they selected, rate on a scale from 0 to 4 how useful they’d found it, how likely they’d be to recommend to a friend getting into the field who hadn’t read widely, and how likely they’d be to recommend to someone paid to do AI alignment research. You can do a test run of the survey at this link.
My summary of the results
AXRP, my podcast, is highly rated among people paid to work on technical AI alignment resources, but less highly rated in other cohorts.
On a personal note, I find this a bit disappointing: I had hoped it could be useful for people orienting to research directions that they had not read widely about.
Rob Miles videos are highly rated among everyone, more than I would have guessed.
People really liked the AI Safety Camp, the AGI Safety Fundamentals Course, and conversations with AI alignment researchers.
People trying to get into alignment really liked the above and also MLAB. That said, they recommend Rob Miles videos higher than the AI Safety Camp and conversations with AI alignment researchers (but lower than MLAB and the AGI Safety Fundamentals Course).
Basic stats
Entries with demographic info: 139
Entries that rate various resources: 99
Number that say ‘I have heard of AI alignment’: 95
Number that say ‘I am interested in AI alignment research’: 109
Number that say ‘I am trying to move into a technical AI alignment career’: 68
Number that say ‘I spend some of my time solving technical problems related to AI alignment’: 51
Number that say ‘I spend some of my time doing AI alignment field/community-building’: 37
Number that say ‘I spend some of my time facilitating technical AI alignment research in ways other than doing it directly’: 35
Number that say ‘I spend some of my time publicly communicating about AI alignment’: 36
Number that say ‘I am paid to work on technical AI alignment research’: 30
Number that say ‘I help run an organization with an AI alignment mission (e.g. CHAI, MIRI, Anthropic)’: 11
Context for questions
When sorting things by ratings, I’ve included the top 5, and anything just below the top 5 if that was a small number. I also included ratings for AXRP, the podcast I make. Ratings are paired with the standard error of the mean (total ratings have this standard error multiplied by the number of people in the sample). Only things that at least 2 people engaged with were included.
Ratings were generally rounded to two significant figures, and standard errors were reported to the same precision.
Usefulness ratings
Among all respondents:
Total usefulness (multiplying average rating by reach):
80k podcast: 167 +/- 8
Superintelligence: 166 +/- 8
Talks by AI alignment researchers: 134 +/- 6
Rob Miles videos: 131 +/- 7
AI alignment ...