The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • LW - Elon talked with senior Chinese leadership about AI X-risk by ChristianKl
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Elon talked with senior Chinese leadership about AI X-risk, published by ChristianKl on June 7, 2023 on LessWrong.
    As part of his Twitter Spaces with RJK jr. Elon said (Youtube-based transcript):
    On my recent trip to China, with the senior leadership there, we had I think some very productive discussions on artificial intelligence risks and the the need for some oversight or regulation.
    My understanding from those conversations is that China will be initiating AI regulation in China so that that was those those were very promising discussions.
    And you know, I pointed out that if you know if if there is a digital super intelligence that is overwhelmingly powerful developed in China, it it is actually a risk to the sovereignty of the Chinese government and I think they took that concern to heart
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    1 min
  • AF - An Exercise to Build Intuitions on AGI Risk by Lauro Langosco
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: An Exercise to Build Intuitions on AGI Risk, published by Lauro Langosco on June 7, 2023 on The AI Alignment Forum.
    Epistemic status: confident that the underlying idea is useful; less confident about the details, though they're straightforward enough that I expect they're mostly in the right direction.
    TLDR: This post describes a pre-mortem-like exercise that I find useful for thinking about AGI risk. It is the only way I know of to train big-picture intuitions about what solution attempts are more or less promising and what the hard parts of the problem are. The (simple) idea is to iterate between constructing safety proposals ('builder step') and looking for critical flaws in a proposal ('breaker step').
    Introduction
    The way that scientists-in-training usually develop research taste is to smash their heads against reality until they have good intuitions about things like which methods tend to work, how to interpret experimental results, or when to trust their proof of a theorem. This important feedback loop is mostly absent in AGI safety research, since we study a technology that does not exist yet (AGI). As a result, it is hard to develop a good understanding of which avenues of research are most promising and what the hard bits of the problem even are.
    The best way I know of to approximate that feedback loop is an iterative exercise with two steps: 1) propose a solution to AGI safety, and 2) look for flaws in the proposal. The idea is simple, but most people don’t do it explicitly or don’t do it often enough.
    Multiple rounds of this exercise tend to bring up details about one’s assumptions and predictions that would otherwise stay implicit or unnoticed. Writing down specific flaws of a specific proposal helps ground more general concepts like instrumental convergence or claims like ‘corrigibility is unnatural’. And after some time, the patterns in the flaws (the ‘hard bits’) become visible on their own.
    I ran an earlier version of this exercise as a workshop (an important component is to discuss your ideas with others, so a workshop format is convenient). Here are the slides.
    The exercise
    The exercise consists of two phases: a builder phase in which you write down a best guess / proposal for how we might avoid existential risk from AGI, and a breaker phase in which you dig into the details until you understand how the proposal fails.
    Importantly, in the context of this exercise the only thing that counts is your own inside view, that is your own understanding of the technical or political feasibility of the proposal. You might have thoughts like “There’s smart people who have thought about this much longer than I have, and they think X; why should I disagree?”. Put that aside for now; the point is to develop your own views, and that works best when you don’t think too much about other people’s views except to inform your own thoughts.
    Builder phase
    Write down the proposal: a plausible story for how we might avoid human extinction or disempowerment due to AGI. It doesn’t need to be very detailed yet; that comes in the breaker phase.
    The proposal will look very different depending on the assumptions you’re starting with.
    If you’re relatively optimistic about AGI risk, the proposal might look very much like things continuing to go on the current trajectory. Write down how you expect the future to go in very broad terms: if we build AGI, how do we know it’ll behave like we want it to? If we don’t build AGI, how come?
    If you’re more pessimistic: what’s the most plausible way in which we could move things from their current trajectory? Is it plausible AI labs can coordinate to not build AGI? Or is there a technical solution that seems promising?
    The builder phase is complete when you have a proposal (can be as short as a paragraph) that seems to you like it stands a d...
    13 min
  • LW - Why I am not a longtermist (May 2022) by boazbarak
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Why I am not a longtermist (May 2022), published by boazbarak on June 6, 2023 on LessWrong.
    [Posting verbatim my blog post from a year ago since it might be relevant to this audience, and I hope it could generate a good discussion. As far as I can tell, cross-posting old material is OK here, though do let me know if not, and I will delete it. I do not intend to cross-post any more old posts from my blog. Note that this post was written for non-LW audience that is not necessarily familiar with longtermism. The advice at the end is aimed mostly at technical folks rather than policy makers. A final note is that this was written before some scandals related to longtermism/EA, though these should not have an impact on the content . --Boaz]
    “Longtermism” is a moral philosophy that places much more weight on the well-being of all future generations than on the current one. It holds that “positively influencing the long-term future is a key moral priority of our time,” where “long term” can be really long term, e.g., “many thousands of years in the future, or much further still.” At its core is the belief that each one of the potential quadrillion or more people that may exist in the future is as important as any single person today.
    Longtermism has recently attracted attention, some of it in alarming tones. The reasoning behind longtermism is natural: if we assume that human society will continue to exist for at least a few millennia, many more people will be born in the future than are alive today. However, since predictions are famously hard to make, especially about the future, longtermism invariably gets wrapped up with probabilities. Once you do these calculations, preventing an infinitely bad outcome, even if it would only happen with tiny probability, will have infinite utility. Hence longtermism tends to focus on so-called “existential risk”: The risk that humanity will go through in an extinction event, like the one suffered by the Neanderthals or Dinosaurs, or another type of irreversible humanity-wise calamity.
    This post explains why I do not subscribe to this philosophy. Let me clarify that I am not saying that all longtermists are bad people. Many “longtermists” have given generously to improve people's lives worldwide, particularly in developing countries. For example, none of the top charities of Givewell (an organization associated with the effective altruism movement, in which many prominent longtermists are members) focus on hypothetical future risks. Instead, they all deal with current pressing issues, including Malaria, childhood vaccinations, and extreme poverty. Overall the effective altruism movement has done much to benefit currently living people. Some of its members donated their kidneys to strangers: These are good people- morally better than me. It is hardly fair to fault people that are already contributing more than most others for caring about issues that I think are less significant.
    Benjamin Todd’s estimates of Effective Altruism resource allocations
    This post critiques the philosophy of longtermism rather than the particular actions or beliefs of “longtermists.” In particular, the following are often highly correlated with one another:
    Belief in the philosophy of longtermism.
    A belief that existential risk is not just a concern for the far-off future and a low-probability event, but there is a very significant chance of it happening in the near future (next few decades or at most a century).
    A belief that the most significant existential risk could arise from artificial intelligence and that this is a real risk in the near future.
    Here I focus on (1) and explain why I disagree with this philosophy. While I might disagree on specific calculations of (2) and (3), I fully agree with the need to think and act regarding near-term risks. Society ...
    15 min
  • EA - A note of caution about recent AI risk coverage by Sean o h
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: A note of caution about recent AI risk coverage, published by Sean o h on June 7, 2023 on The Effective Altruism Forum.
    Epistemic status: some thoughts I wanted to get out quickly
    A lot of fantastic work has been done by people in the AI existential risk research community and related communities over the last several months in raising awareness about risks from advanced AI. However, I have some cause for unease that I’d like to share.
    These efforts may have been too successful too soon.
    Or, more specifically, this level of outreach success this far ahead of the development of AI capable of posing existential risk may have fallout. We should consider steps to mitigate this.
    (1) Timelines
    I know that there are well-informed people in the AI and existential risk communities who believe AI capable of posing existential risk may be developed within 10 years. I certainly can’t rule this out, and even a small chance of this is worth working to prevent or mitigate to the extent possible, given the possible consequences. My own timelines are longer, although my intuitions don’t have a rigorous model underpinning them (my intuitions line up similarly to the 15-40 year timelines mentioned in this recent blog post by Matthew Barnett from Epoch).
    Right now the nature of media communications means that the message is coming across with a lot of urgency. From speaking to lay colleagues, impressions often seem to be of short timelines (and some folks e.g. Geoff Hinton have explicitly said 5-20 years, sometimes with uncertainty caveats and sometimes without).
    It may be that those with short (<10 years) timelines are right. And even if they’re not, and we’ve got decades before this technology poses an existential threat, many of the attendant challenges – alignment, governance, distribution of benefits – will need that additional time to be addressed. And I think it’s entirely plausible that the current level of buy-in will be needed in order to initiate the steps needed to avoid the worst outcomes, e.g. recruiting expertise and resources to alignment, development and commitment to robust regulation, even coming to agreements not to pursue certain technological developments beyond a certain point.
    However, if short timelines do not transpire, I believe there’s a need to consider a scenario I think is reasonably likely.
    (2) Crying wolf
    I propose that it is most likely we are in a world where timelines are >10 years, perhaps >20 or 30 years. Right now this issue has a lot of the most prominent AI scientists and CEOs signed up, and political leaders worldwide committing to examining the issue seriously (examples from last week). What happens then in the >10 year-timeline world?
    The extinction-level outcomes that the public is hearing, and that these experts are raising and policymakers making costly reputational investments in, don’t transpire. What does happen is all the benefits of near-term AI that have been talked about, plus all the near-term harms that are being predominantly raised by the AI ethics/FAccT communities. Perhaps these harms include somewhat more extreme versions than what is currently talked about, but nowhere near catastrophic. Suddenly the year is 2028, and that whole 2023 furore is starting to look a bit silly. Remember when everyone agreed AI was going to make us all extinct? Yeah, like Limits to Growth all over again. Except that we’re not safe. In reality, in this scenario, we’re just entering the period in which risk is most acute, and in which gaining or maintaining the support of leaders across society for coordinated action is most important.
    And it’s possibly even harder to convince them, because people remember how silly lots of people looked the last time.
    (3) How to navigate this scenario (in advance).
    Suggestions:
    Have our messaging make clear that we ...
    7 min
  • EA - Large epistemological concerns I should maybe have about EA a priori by Luise
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Large epistemological concerns I should maybe have about EA a priori, published by Luise on June 7, 2023 on The Effective Altruism Forum.
    Note
    I originally wrote this as a private doc, but I thought maybe it's valuable to publish. I've only minimally edited it.
    Also, I now think the epistemological concerns listed below aren't super clearly carved and have a lot of overlap. The list was never meant to be a perfect carving, just to motion at the shape of my overall concerns, but even so, I'd write it differently if I was writing it today.
    Motivation
    For some time now, I’ve wanted nothing more than to finish university and just work on EA projects I love. I’m about to finish my third year of university and could do just that. A likely thing I would work on is alignment field-building, e.g., helping to run the SERI MATS program again. (In this doc, will use alignment field-building as the representative of all the community building/operations-y projects I’d like to work on, for simplicity.)
    However, in recent months, I have become more careful about how I form opinions. I am more truthseeking and more epistemically modest (but also more hopeful that I can do more than blind deferral in complex domains). I now no longer endorse the epistemics (used here broadly as “ways of forming beliefs”) that led me to alignment field-building in the first place. For example, I think this in part looked like “chasing cool, weird ideas that feel right to me” and “believing whatever high-status EAs believe”.
    I am now deeply unsure about many assumptions underpinning the plan to do alignment field-building. I think I need to take some months to re-evaluate these assumptions.
    In particular, here are the questions I feel I need to re-evaluate:
    1. What should my particular takes about particular cause areas (chiefly alignment) and about community building be?
    My current takes often feel immodest and/or copied from specific high-status people. For example, my takes on which alignment agendas are good are entirely copied from a specific Berkeley bubble. My takes on the size of the “community building multiplier” are largely based on quite immodest personal calculations, disregarding that many “experts” think the multiplier is lower.
    I don’t know what the right amount of immodesty and copying from high-status people is, but I’d like to at least try to get closer.
    2. Is the “EA viewpoint” on empirical issues (e.g., on AI risk) correct (because we are so smart)?
    Up until recently I just assumed (a part of) EA is right about large empirical questions like “How effectively-altruistic is ‘Systemic Change’?”, “How high are x-risks?” and “Is AI an x-risk?”. (“Empirical” as opposed to “moral”.) First, this was maybe a naïve kind of tribalistic support, later because of the “superior epistemics” of EAs. The poster version of this is “Just believe whatever Open Phil says”.
    Here’s my concern: In general, people adopt stories they like on big questions, e.g., the capitalism-is-cancer-and-we-need-to-overhaul-the-system story or the AI-will-change-everything-tech-utopia story. People don’t seek out all the cruxy information and form credences to actually get closer to the truth. I used to be fine just to back “a plausible story of how things are”, as I suspect many EAs are. But now I want to back the correct story of how things are.
    I’m wondering if the EA/Open Phil worldview is just a plausible story. This story probably contains a lot of truthseeking and truth on lower-level questions, such as “How effective is deworming?”. But on high-level questions such as “How big a deal is AGI?”, maybe it is close to impossible not just to believe in a story and instead do the hard truthseeking thing. Maybe that would be holding EA/Open Phil to an impossible standard. I simply don’t know currently if EA/Open Phil ep...
    12 min
  • EA - Unveiling the Challenges and Potential of Research in Nigeria: Nurturing Talent in Resource-Limited Settings by emmannaemeka
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Unveiling the Challenges and Potential of Research in Nigeria: Nurturing Talent in Resource-Limited Settings, published by emmannaemeka on June 7, 2023 on The Effective Altruism Forum.
    Summary
    This essay sheds light on the challenges faced by academics working in public institutions in Nigeria, aiming to provide insight into the limited impact of research in the Nigerian context. Aiming to answer the question, why are we not as impactful as expected? It emphasizes the experiences of researchers from resource-limited situations, with a focus on my personal journey as a Nigerian researcher.
    Background
    I graduated from Nnamdi Azikiwe University in Awka with a Ph.D. in medical microbiology. Currently, I am a lecturer at Plateau State University, Bokkos, Nigeria. In order to finish my Ph.D. study, I spent three months conducting Ph.D. benchwork at Duke University in the United States. I was fortunate to get local funding for my doctorate from the Tertiary Education Trust Fund, which enabled me to travel to Duke for my doctorate. Not everyone is that fortunate. People just very rarely receive sponsorship for post-graduate education in our Nigerian setting. Most people finance their postgraduate education on their own.
    You must pay both your school fees and your research expenses as a postgraduate student in Nigeria. I've begun supervising both undergraduate and graduate students. What I saw at Duke and what I have heard from developed universities is that university supervisors provide their students with research labs and consumables through grants They also offer assistance through post-doctoral training programs after receiving a PhD.
    The ordinary postgraduate student here is not like that. What ground-breaking outcomes or depth of study will self-funding enable? On the other hand, few students are fortunate enough to receive collaboration for their projects either directly or through the assistance of their supervisors. In my experience as a supervisor, the university system offers me zero financial assistance for my students' projects.
    What is it like to do research here?
    Although my experience might not be representative of all academics in Nigeria. It can be used to illustrate what it's like to conduct research in a Nigerian university and what it's like to hold a professorial position there. Very few scholars focus on a certain topic or element. For example. specialist in the development of bacterial cell walls. or something else. The majority of the time, you will find a lecturer's research articles dispersed throughout many areas. What causes this? As a medical microbiologist, I have published in the fields of mycology, virology, and global warming. At the beginning of my work, while pursuing my Masters degree, I isolated Candida africana with the intention of concentrating on it and thoroughly examining its biology and pathology.
    Because there are no labs in the nation that can do this kind of research, it was not possible. I so gave up on the research part. I then proceeded on to my doctoral work, where I examined the molecular characterization of the environmental Cryptococcus neoformans. This research was at Duke University. When I got home, I had a ton of questions, such as: What causes the genetic diversity of C. neoformans in Nigeria? What impact has rising temperatures had on this species' evolution of virulence? . Rarely will you find a lab where "ordinary" PCR can be performed. How are consumables purchased? Electricity is a problem. I came to the realization that I could neither pursue these inquiries in Nigeria nor the biology of this fungus. If I must continue studying this pathogen, I will be limited to studying its genotype and epidemiology (which requires cooperation with international labs).
    I started looking at how environmental infections are r...
    8 min
  • EA - Successif: helping mid-career and senior professionals have impactful careers by ClaireB
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Successif: helping mid-career and senior professionals have impactful careers, published by ClaireB on June 7, 2023 on The Effective Altruism Forum.
    We’re Successif, we’ve been around for a year, and we’re excited to finally formally introduce ourselves to the EA community. This post will cover who we are, what we have been doing, some lessons learnt in the past year, and how you can contribute to our mission!
    Executive summary:
    Successif, previously known as EA Pathfinder and created over a year ago, is an organization designed to support mid-career and senior professionals transition into high-impact work. We adopt a holistic approach focused on cause prioritization, personal fit, and aptitude building. We offer collective workshops, one-on-one mentoring, women leadership workshops, peer support groups, and match-making.
    In this post, we are sharing the most common bottlenecks mid-career professionals face, what we learnt about giving people permission, and issues specific to women.
    We are also inviting the community to contribute through referring candidates to our programs, sharing thoughts on our strategy and activities, providing voluntary help, and contributing funds to our new AI program. In a follow-up post, we will present that program.
    1. Context on Successif
    Successif was created in May of 2022 as a result of the belief that there were mid-career and senior professionals aligned with EA values who did not work on EA causes due to lack of information, misconceptions or blockers, and that much expected value would be gained if the community captured these people earlier, especially those who could work on longtermist causes.
    Further investigation revealed a notable gap: a lack of resources and programs tailored to support mid-career and senior professionals in addressing the world’s most urgent problems. For instance, 80,000 Hours’ materials often cater mostly to young individuals, leaving an important segment underserved. To fill this gap, EA Pathfinder—the predecessor to Successif—was launched in 2022. Since then, we have rebranded and refined our strategy accordingly.
    Successif’s core mission is to create a world in which professionals motivated by evidence and reason can find high impact work. Focusing on mid-career and senior professionals leverages unique expertise, skills, and experience to address pressing global issues and fill certain skills gaps in the high-impact talent pipeline.
    We recognize that our audience has specific needs, blockers, and concerns when it comes to transitioning to high-impact work, especially when the work is in a different field. We provide coaching, upskilling through training programs, networking opportunities, and matches with relevant opportunities. More fundamentally, we take a human-centered approach, helping mentees navigate the uncertainties that accompany career transitions. We help address feelings of discouragement from uncertain outcomes and overcome psychological barriers preventing them from being their most impactful professional self.
    We work in six core areas: Technical AI Safety and AI Governance, Biorisk Prevention, Nuclear Arms Risk Prevention, Climate Change, Animal Welfare, and Global Health and Development. We have launched a specific track for AI jobs, which we will cover in a subsequent post.
    2. What we do
    A. Our approach
    Our approach to career advising is based on the ikigai model and on the aptitudes framework.
    Ikigai Model
    “Ikigai (き, lit. 'a reason for being'): Japanese concept referring to something that gives a person a sense of purpose, a reason for living.” When it comes to career advising, the Ikigai model offers valuable insights and guidance for career advising. It empowers us to effectively help our advisees discover what is at the intersection of what they love, what they’re good at, w...
    17 min
  • LW - Transformative AGI by 2043 is <1% likely by Ted Sanders
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Transformative AGI by 2043 is <1% likely, published by Ted Sanders on June 6, 2023 on LessWrong.
    (Crossposted to the EA forum)
    Abstract
    The linked paper is our submission to the Open Philanthropy AI Worldviews Contest. In it, we estimate the likelihood of transformative artificial general intelligence (AGI) by 2043 and find it to be <1%.
    Specifically, we argue:
    The bar is high: AGI as defined by the contest—something like AI that can perform nearly all valuable tasks at human cost or less—which we will call transformative AGI is a much higher bar than merely massive progress in AI, or even the unambiguous attainment of expensive superhuman AGI or cheap but uneven AGI.
    Many steps are needed: The probability of transformative AGI by 2043 can be decomposed as the joint probability of a number of necessary steps, which we group into categories of software, hardware, and sociopolitical factors.
    No step is guaranteed: For each step, we estimate a probability of success by 2043,conditional on prior steps being achieved. Many steps are quite constrained by the short timeline, and our estimates range from 16% to 95%.
    Therefore, the odds are low: Multiplying the cascading conditional probabilities together, we estimate that transformative AGI by 2043 is 0.4% likely. Reaching >10% seems to require probabilities that feel unreasonably high, and even 3% seems unlikely.
    Thoughtfully applying the cascading conditional probability approach to this question yields lower probability values than is often supposed. This framework helps enumerate the many future scenarios where humanity makes partial but incomplete progress toward transformative AGI.
    Executive summary
    For AGI to do most human work for <$25/hr by 2043, many things must happen.
    We forecast cascading conditional probabilities for 10 necessary events, and find they multiply to an overall likelihood of 0.4%:
    We invent algorithms for transformative AGI60%We invent a way for AGIs to learn faster than humans40%AGI inference costs drop below $25/hr (per human equivalent)16%We invent and scale cheap, quality robots60%We massively scale production of chips and power46%We avoid derailment by human regulation70%We avoid derailment by AI-caused delay90%We avoid derailment from wars (e.g., China invades Taiwan)70%We avoid derailment from pandemics90%We avoid derailment from severe depressions95%Joint odds0.4%
    Event
    Forecast
    by 2043 or TAGI,conditional onprior steps
    If you think our estimates are pessimistic, feel free to substitute your own here. You’ll find it difficult to arrive at odds above 10%.
    Of course, the difficulty is by construction. Any framework that multiplies ten probabilities together is almost fated to produce low odds.
    So a good skeptic must ask: Is our framework fair?
    There are two possible errors to beware of:
    Did we neglect possible parallel paths to transformative AGI?
    Did we hew toward unconditional probabilities rather than fully conditional probabilities?
    We believe we are innocent of both sins.
    Regarding failing to model parallel disjunctive paths:
    We have chosen generic steps that don’t make rigid assumptions about the particular algorithms, requirements, or timelines of AGI technology
    One opinionated claim we do make is that transformative AGI by 2043 will almost certainly be run on semiconductor transistors powered by electricity and built in capital-intensive fabs, and we spend many pages justifying this belief
    Regarding failing to really grapple with conditional probabilities:
    Our conditional probabilities are, in some cases, quite different from our unconditional probabilities. In particular, we assume that a world on track to transformative AGI will.
    Construct semiconductor fabs and power plants at a far faster pace than today (our unconditional probability is substantially lower)
    Have invented very che...
    11 min
  • EA - US Policy Career Resources by US Policy Careers
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: US Policy Career Resources, published by US Policy Careers on June 7, 2023 on The Effective Altruism Forum.
    Background
    This post contains a collection of resources for aspiring policy professionals in the US, including articles, books, newsletters, podcasts, and more. It focuses on resources most relevant to people seeking to work in US federal-level technology or security policy, such as AI policy or biosecurity policy.
    The post is split into two parts: the first consists of career-specific resources, providing both strategic advice on high-level career decisions and tactical advice on applying for particular opportunities. The second consists of topic-specific resources to help readers learn about particular policy areas relating to emerging technology and security policy, including AI policy, biosecurity policy, and nuclear security policy.
    This collection consists of resources that different DC professionals have recommended. It does not aim to be comprehensive, and we haven’t vetted all these resources individually. The collection is also a work-in-progress, and we appreciate any feedback (e.g., resources we missed, better ways to structure this post) via this form or in the comments.
    I. Career-specific policy resources
    General US policy career resources
    US Policy Careers account on the EA Forum
    Government and policy in an area relevant to a top problem, 80,000 Hours
    Advice for Undergraduates Interested in US Policy
    Takeaways on US Policy Careers (Part 1): Paths to Impact and Personal Fit
    Takeaways on US Policy Careers (Part 2): Career Advice
    Books:
    The Great Courses: Understanding the US Government (Audible) (2020)
    Hack Your Bureaucracy: Get Things Done No Matter What Your Role on Any Team (2022)
    Podcasts:
    Transition Lab, Partnership for Public Service
    Stories from the Backchannel, Center for a New American Security
    Other policy resource lists
    GoGovernment Resources, Partnership for Public Service
    Resources Overview, Network on Emerging Threats
    Resources, United States of Technology
    Relevant EA Forum tags: US policy, Policy, Career choice, Job profile, Governance of artificial intelligence
    Policy work opportunities
    Policy job boards
    USAJobs.gov, the government’s job board for federal agencies (see USAJobs guide)
    Employment Bulletins for the House, Senate, and Senate Internships
    Resume Banks for the House and Senate
    Paid:
    Traverse Jobs, focus on Congress and advocacy
    Tom Manatos Jobs, focus on DC policy (e.g., Congress, federal agencies)
    Daybook, focus on political, policy, and non-profit jobs
    List of progressive job boards
    80,000 Hours Job Board, includes some policy jobs and internships
    EA Opportunity Board, includes some policy internships
    Early-Career Opportunities in Governance and Policy
    Policy internships
    Consider "Semester in DC" Programs, if You're a US Student Interested in Policy
    Congressional Internships: Why and How to Apply
    Virtual Student Federal Service: remote government internships for US students
    Think tank internships section from Working at a (DC) policy think tank
    USAjobs.gov internships for students and recent graduates (see also list here and USAjobs guide here)
    Policy fellowships
    Database of EA-relevant US policy fellowships (+ these databases)
    Horizon Fellowship (previously Open Philanthropy Technology Policy Fellowship)
    TechCongress Fellowship
    Presidential Management Fellowship (+ PMF application tips)
    STPI Science Policy Fellowship
    Scoville Fellowship
    Policy graduate school
    US policy master’s degrees:
    Why and When? (Part 1)
    Top Programs, Applications, & Funding (Part 2)
    US policy master’s database
    Law school:
    Why and When? (Part 1)
    Admissions and Financial Advice (Part 2)
    PhD:
    How To PhD
    How to apply for a PhD
    Career review: Economics PhD, 80,000 Hours
    Policy institutions
    Legislative branch (Congress)
    Working in Congress (Part 1): Bac...
    19 min
  • LW - Cultivate an obsession with the object level (the world is fascinating) by Richard Ngo
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Cultivate an obsession with the object level (the world is fascinating), published by Richard Ngo on June 7, 2023 on LessWrong.
    In this third section of the sequence I focus on how to leverage positive motivations—in particular curiosity, agency, and determination—to do great work. While all of these are valuable, they’ll suit different people to different degrees. In particular, I think of nerds as favoring curiosity, which is the motivation I’ll focus on in this post. In order to do great work in a given area, you need to spend a lot of time thinking about it, with many of the most exceptional people having an obsessive interest in what they’re working on. While it’s possible to do that via determination alone, curiosity is a much easier source of motivation.
    I want to start by distinguishing two types of curiosity: detail-oriented and systematizing. Detail-oriented curiosity is about understanding how things work—like a child who keeps tinkering with blocks until they’ve figured out all the interesting structures that can be built with them. The best way to cultivate detail-oriented curiosity is to learn via answering specific questions or carrying out concrete tasks—e.g. learning programming by building cool apps, or learning physics by building a model rocket, or learning history by figuring out what your life would be like at different points in the past. When you do that, one initial line of exploration can branch out into many more topics. And the patient and direct observation which allows you to discover new things is much easier in pursuit of a goal which genuinely interests you, rather than an externally-imposed goal like those given to kids in schools.
    Systematizing curiosity, by contrast, tries to understand the context of a topic in order to fit it into a holistic model of the world—like a child who keeps asking “why?” until they reach the highest known level of abstraction. That might mean studying the Romans by analyzing their role within the broad sweep of history; or studying an animal species by figuring out where they fit into their ecosystem or the tree of life. Systematizing curiosity can be sparked by looking out for deep structure and order in the universe, even (or especially) the parts that weren’t deliberately designed to be structured and orderly. Systematizing and detail-oriented curiosity are complementary: the former guides your exploration towards the most important domains, but the latter is necessary for a deep understanding of them.
    I’ve used examples about children to highlight that obsessive curiosity is in some sense the default human state. Why does it go away? One barrier to systematizing curiosity is that, as we grow older, the world becomes less mysterious, because we have existing frameworks for making sense of it. But even if you already have one high-level framework for understanding a topic, there are often many more which you’re yet to discover. You might already understand the physics of airplanes, but not their economic or logistical or sociological consequences. Or you might understand how the Romans shaped the geopolitics of Europe, but not how they shaped the progress of science or religion or military strategy. New frames like these often cross-apply to many different topics, which makes it valuable to keep looking with new eyes for questions which spark systematizing curiosity even in seemingly-impractical domains.
    Another big reason that we become less curious over time is that expressing curiosity requires admitting ignorance, which we learn to fear—especially when someone else already knows the answer and we might look stupid by comparison. Similarly, learning by doing projects exposes us to the scary possibility of failing at those projects—especially when school taught many of us that we’d be punished for ge...
    5 min