The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • LW - Apply now to rationality camps: ESPR & PAIR - new Program on AI and Reasoning (ages 16-20) by Anna Gajdova
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Apply now to rationality camps: ESPR & PAIR - new Program on AI and Reasoning (ages 16-20), published by Anna Gajdova on March 24, 2023 on LessWrong.
    We are happy to announce that the ESPR team is running two immersive summer workshops for mathematically talented students this year: A classic applied rationality camp, ESPR, and PAIR, a new program focusing on AI and cognition:
    Program on AI and Reasoning (PAIR) for students with an interest in artificial intelligence, cognition, and reasoning in general.
    The workshop aims to provide participants with an in-depth understanding of how current AI systems work, mathematical theories about cognition and human minds, and how the two relate. Additionally, the workshop teaches thinking and meta-cognitive tools related to creativity, motivation, collaboration, and ability to drive and lead independent inquiry. Alumni of the camp should be in a better position to think about AI independently, understand state-of-art research, and come up with their own research ideas or AI projects. See the curriculum details.
    Students who are 16-20 years old
    August 3rd - August 13th in Cambridge, United Kingdom
    European Summer Program on Rationality (ESPR) for students with a desire to understand themselves and the world, and interest in applied rationality.
    The curriculum covers a wide range of topics, from game theory, cryptography, and mathematical logic, to AI, styles of communication, and cognitive science. The goal of the program is to help students hone rigorous, quantitative skills as they acquire a toolbox of useful concepts and practical techniques applicable in all walks of life. See the content details.
    Students who are 16-19 years old
    August 17th - August 27th in Oxford, United Kingdom
    We strongly encourage all teenage LessWrong readers with an interest in these topics to apply.
    Both programs are free for accepted students, travel scholarships available. Apply to both camps here. First application deadline: April 16th.
    If you know students aged 16-20 years who might enjoy these camps, please send them this link with an overview of both camp:.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    3 min
  • EA - Reflecting on the Last Year — Lessons for EA (opening keynote at EAG) by Toby Ord
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Reflecting on the Last Year — Lessons for EA (opening keynote at EAG), published by Toby Ord on March 24, 2023 on The Effective Altruism Forum.
    I recently delivered the opening talk for EA Global: Bay Area 2023. I reflect on FTX, the differences between EA and utilitarianism, and the importance of character. Here's the recording and transcript.
    The Last Year
    Let’s talk a bit about the last year.
    The spring and summer of 2022 were a time of rapid change. A second major donor had appeared, roughly doubling the amount of committed money. There was a plan to donate this new money more rapidly, and to use more of it directly on projects run by people in the EA community. Together, this meant much more funding for projects led by EAs or about effective altruism.
    It felt like a time of massive acceleration, with EA rapidly changing and growing in an attempt to find enough ways to use this money productively and avoid it going to waste. This caused a bunch of growing pains and distortions.
    When there was very little money in effective altruism, you always knew that the person next to you couldn’t have been in it for the money — so they must have been in it because they were passionate about what they were doing for the world. But that became harder to tell, making trust harder.
    And the most famous person in crypto had become the most famous person in EA. So someone whose views and actions were quite radical and unrepresentative of most EAs, became the most public face of effective altruism, distorting public perception and even our self-perception of what it meant to be an EA. It also meant that EA became more closely connected to an industry that was widely perceived as sketchy. One that involved a product of disputed social value, and a lot of sharks.
    One thing that especially concerned me was a great deal of money going into politics. We’d tried very hard over the previous 10 years to avoid EA being seen as a left or right issue — immediately alienating half the population. But a single large donor had the potential to change that unilaterally.
    And EA became extremely visible: people who’d never heard of it all of a sudden couldn’t get away from it, prompting a great deal of public criticism.
    From my perspective at the time, it was hard to tell whether or not the benefits of additional funding for good causes outweighed these costs — both were large and hard to compare. Even the people who thought it was worth the costs shared the feelings of visceral acceleration: like a white knuckled fairground ride, pushing us up to vertiginous heights faster than we were comfortable with.
    And that was just the ascent.
    Like many of us, I was paying attention to the problems involved in the rise, and was blindsided by the fall.
    As facts started to become more clear, we saw that the companies producing this newfound income had been very poorly governed, allowing behaviour that appears to me to have been both immoral and illegal — in particular, it seems that when the trading arm had foundered, customers’ own deposits were raided to pay for an increasingly desperate series of bets to save the company.
    Even if that strategy had worked and the money was restored to the customers, I still think it would have been illegal and immoral. But it didn’t work, so it also caused a truly vast amount of harm. Most directly and importantly to the customers, but also to a host of other parties, including the members of the EA community and thus all the people and animals we are trying to help.
    I’m sure most of your have thought a lot about this over last few months. I’ve come to think of my own attempts to process this as going through these four phases.
    First, there’s: Understanding what happened.
    What were the facts on the ground?
    Were crimes committed?
    How much money have customer’s lost?
    A lot of t...
    25 min
  • LW - Microsoft Research Paper Claims Sparks of Artificial Intelligence in GPT-4 by Zvi
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Microsoft Research Paper Claims Sparks of Artificial Intelligence in GPT-4, published by Zvi on March 24, 2023 on LessWrong.
    Microsoft Research (conflict of interest? what’s that?) has issued a 154-page report entitled Sparks of Artificial Intelligence: Early Experiments With GPT-4, essentially saying that GPT-4 could reasonably be viewed as a kind of early stage proto-AGI.
    This post will go over the paper, and the arguments they offer.
    Here is their abstract:
    Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The latest model developed by OpenAI, GPT-4 [Ope23], was trained using an unprecedented scale of compute and data.
    In this paper, we report on our investigation of an early version of GPT-4, when it was still in active development by OpenAI. We contend that (this early version of) GPT4 is part of a new cohort of LLMs (along with ChatGPT and Google’s PaLM for example) that exhibit more general intelligence than previous AI models. We discuss the rising capabilities and implications of these models.
    We demonstrate that, beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more, without needing any special prompting. Moreover, in all of these tasks, GPT-4’s performance is strikingly close to human-level performance, and often vastly surpasses prior models such as ChatGPT.
    Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. In our exploration of GPT-4, we put special emphasis on discovering its limitations, and we discuss the challenges ahead for advancing towards deeper and more comprehensive versions of AGI, including the possible need for pursuing a new paradigm that moves beyond next-word prediction. We conclude with reflections on societal influences of the recent technological leap and future research directions.
    The paper is about an early and non-multimodal version of GPT-4. I do not think this much impacted the conclusions.
    Their method seems to largely be ‘look at all these tasks GPT-4 did well on.’
    I am not sure why they are so impressed by the particular tasks they start with. The first was ‘prove there are an infinite number of primes in the form of a rhyming poem.’ That seems like a clear case where the proof is very much in the training data many times, so you’re asking it to translate text into a rhyming poem, which is easy for it – for a challenge, try to get it to write a poem that doesn’t rhyme. Variations seem similar, these tasks almost seem chosen to be where GPT-3.5 was most impressive.
    Introductions don’t actually matter, though. What’s the actual test?
    We execute the approach outlined above on a few selected topics that roughly cover the different aptitudes given in the 1994 definition of intelligence, a very general mental capability that, among other things, involves the ability to reason, plan, solve problems, think abstractly, comprehend complex ideas, learn quickly and learn from experience.
    [Note: List here is edited to remove detail.]
    GPT-4’s primary strength is its unparalleled mastery of natural language. It can not only generate fluent and coherent text, but also understand and manipulate it in various ways, such as summarizing, translating, or answering an extremely broad set of questions.
    Coding and mathematics are emblematic of the ability to reason and think abstractly. We explore GPT4’s abilities in these domains respectively in Section 3 and Section 4.
    In Section 5, we test the model’s ability to plan and solve pro...
    11 min
  • EA - Holden Karnofsky’s recent comments on FTX by Lizka
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Holden Karnofsky’s recent comments on FTX, published by Lizka on March 24, 2023 on The Effective Altruism Forum.
    Holden Karnofsky has recently shared some reflections on EA and FTX, but they’re spread out and I’d guess that few people have seen them, so I thought it could be useful to collect them here. (In general, I think collections like this can be helpful and under-supplied.) I've copied some comments in full, and I've put together a simpler list of the links in this footnote.
    These comments come after a few months — there’s some explanation of why that is in this post and in this comment.
    Updates after FTX
    I found the following comment (a summary of updates he’s made after FTX) especially interesting (please note that I’m not sure I agree with everything):
    Here’s a followup with some reflections.
    Note that I discuss some takeaways and potential lessons learned in this interview.
    Here are some (somewhat redundant with the interview) things I feel like I’ve updated on in light of the FTX collapse and aftermath:
    The most obvious thing that’s changed is a tighter funding situation, which I addressed here.
    I’m generally more concerned about the dynamics I wrote about in EA is about maximization, and maximization is perilous. If I wrote that piece today, most of it would be the same, but the “Avoiding the pitfalls” section would be quite different (less reassuring/reassured). I’m not really sure what to do about these dynamics, i.e., how to reduce the risk that EA will encourage and attract perilous maximization, but a couple of possibilities:
    It looks to me like the community needs to beef up and improve investments in activities like “identifying and warning about bad actors in the community,” and I regret not taking a stronger hand in doing so to date. (Recent sexual harassment developments reinforce this point.).
    I’ve long wanted to try to write up a detailed intellectual case against what one might call “hard-core utilitarianism.” I think arguing about this sort of thing on the merits is probably the most promising way to reduce associated risks; EA isn’t (and I don’t want it to be) the kind of community where you can change what people operationally value just by saying you want it to change, and I think the intellectual case has to be made. I think there is a good substantive case for pluralism and moderation that could be better-explained and easier to find, and I’m thinking about how to make that happen (though I can’t promise to do so soon).
    I had some concerns about SBF and FTX, but I largely thought of the situation as not being my responsibility, as Open Philanthropy had no formal relationship to either. In hindsight, I wish I’d reasoned more like this: “This person is becoming very associated with effective altruism, so whether or not that’s due to anything I’ve done, it’s important to figure out whether that’s a bad thing and whether proactive distancing is needed.”
    I’m not surprised there are some bad actors in the EA community (I think bad actors exist in any community), but I’ve increased my picture of how much harm a small set of them can do, and hence I think it could be good for Open Philanthropy to become more conservative about funding and associating with people who might end up being bad actors (while recognizing that it won’t be able to predict perfectly on this front).
    Prior to the FTX collapse, I had been gradually updating toward feeling like Open Philanthropy should be less cautious with funding and other actions; quicker to trust our own intuitions and people who intuitively seemed to share our values; and generally less cautious. Some of this update was based on thinking that some folks associated with FTX were being successful with more self-trusting, less-cautious attitudes; some of it was based on seeing few immediate negative conse...
    8 min
  • LW - Abstracts should be either Actually Short™, or broken into paragraphs by Raemon
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Abstracts should be either Actually Short™, or broken into paragraphs, published by Raemon on March 24, 2023 on LessWrong.
    It looks to me like academia figured out (correctly) that it's useful for papers to have an abstract that makes it easy to tell-at-a-glance what a paper is about. They also figured out that abstract should be about a paragraph. Then people goodharted on "what paragraph means", trying to cram too much information in one block of text. Papers typically have ginormous abstracts that should actually broken into multiple paragraphs.
    I think LessWrong posts should probably have more abstracts, but I want them to be nice easy-to-read abstracts, not worst-of-all-worlds-goodharted-paragraph abstracts. Either admit that you've written multiple paragraphs and break it up accordingly, or actually streamline it into one real paragraph.
    Sorry to pick on the authors of this particular post, but my motivating example today was bumping into the abstract for the Natural Abstractions: Key claims, Theorems, and Critiques. It's a good post, it's opening summary happened to be written in an academic-ish style that exemplified the problem. It opens with:
    TL;DR: John Wentworth’s Natural Abstraction agenda aims to understand and recover “natural” abstractions in realistic environments. This post summarizes and reviews the key claims of said agenda, its relationship to prior work, as well as its results to date. Our hope is to make it easier for newcomers to get up to speed on natural abstractions, as well as to spur a discussion about future research priorities. We start by summarizing basic intuitions behind the agenda, before relating it to prior work from a variety of fields. We then list key claims behind John Wentworth’s Natural Abstractions agenda, including the Natural Abstraction Hypothesis and his specific formulation of natural abstractions, which we dub redundant information abstractions. We also construct novel rigorous statements of and mathematical proofs for some of the key results in the redundant information abstraction line of work, and explain how those results fit into the agenda.
    Finally, we conclude by critiquing the agenda and progress to date. We note serious gaps in the theoretical framework, challenge its relevance to alignment, and critique John's current research methodology.
    There are 179 words. They blur together, I have a very hard time parsing it. If this were anything other than an abstract I expect you'd naturally write it in about 3 paragraphs:
    TL;DR: John Wentworth’s Natural Abstraction agenda aims to understand and recover “natural” abstractions in realistic environments. This post summarizes and reviews the key claims of said agenda, its relationship to prior work, as well as its results to date. Our hope is to make it easier for newcomers to get up to speed on natural abstractions, as well as to spur a discussion about future research priorities.
    We start by summarizing basic intuitions behind the agenda, before relating it to prior work from a variety of fields. We then list key claims behind John Wentworth’s Natural Abstractions agenda, including the Natural Abstraction Hypothesis and his specific formulation of natural abstractions, which we dub redundant information abstractions. We also construct novel rigorous statements of and mathematical proofs for some of the key results in the redundant information abstraction line of work, and explain how those results fit into the agenda.
    Finally, we conclude by critiquing the agenda and progress to date. We note serious gaps in the theoretical framework, challenge its relevance to alignment, and critique John's current research methodology.
    If I try to streamline this without losing info, it's still hard to get it into something less than 3 paragraphs (113 words)
    We review John Wentwor...
    9 min
  • AF - Wittgenstein and ML — parameters vs architecture by Cleo Nardo
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Wittgenstein and ML — parameters vs architecture, published by Cleo Nardo on March 24, 2023 on The AI Alignment Forum.
    Status: a brief distillation of Wittgenstein's book On Certainty, using examples from deep learning and GOFAI, plus discussion of AI alignment and interpretability.
    "That is to say, the questions that we raise and our doubts depend on the fact that some propositions are exempt from doubt, are as it were like hinges on which those turn."
    Ludwig Wittgenstein, On Certainty
    1. Deep Learning
    Suppose we want a neural network to detect whether two children are siblings based on photographs of their face. The network will received two n-dimensional vectors v1 and v2representing the pixels in each image, and will return a value y(v1,v2)∈R which we interpret as the log-odds that the children are siblings. So the model has type-signature Rn+nR.
    There are two ways we can do this.
    We could use an architecture yA(v1,v2)=σ(vT1Av2+b), where
    σ is the sigmoid function
    A is an n×n matrix of learned parameters,
    b∈R is a learned bias.
    This model has n2+1 free parameters.
    Alternatively, we could use an architecture yU(v1,v2)=σ(vT1(U+UT2)v2+b), where
    σ is the sigmoid function
    U is an n×n upper-triangular matrix of learned parameters
    b∈R is a learned bias
    This model has n2/2+n/2+1 free parameters.
    Each model has a vector of free parameters θ∈Θ. If we train the model via SGD on a dataset (or via some other method) we will end up with a trained models yθ:Rn+nR, where y_:Θ(Rn+nR) is the architecture.
    Anyway, we now have two different NN models, and we want to ascribe beliefs to each of them. Consider the proposition ϕ that siblingness is symmetric, i.e. every person is the sibling of their siblings. What does it mean to say that a model knows or belives that ϕ.
    Let's start with a black-box definition of knowledge or belief: when we say that a model knows or believes that ϕ, we mean that yθ(v1,v2)=yθ(v2,v1) for all v1,v2∈Rn which look sufficiently like faces. According to this black-box definition, both trained models believe ϕ.
    But if we peer inside the black box, we can see that NN Model 1 believes ϕ in a very different way than how NN Model 2 believes ϕ.
    For NN Model 1, the belief is encoded in the learned parameters θ∈Θ.
    For NN Model 2, the belief is encoded in the architecture itself y_.
    These are two different kinds of belief.
    2. Symbolic Logic
    Suppose we use GOFAI/symbolic logic to determine whether two children are siblings.
    Our model consists of three things
    A language L consisting of names and binary familial relations.
    A knowledge-base Γ consisting of L-formulae.
    A deductive system ⊢ which takes a set of L-formulae (premises) to a larger set of L-formulae (conclusions).
    There are two ways we can do this.
    We could use a system (L,Γ,⊢) , where
    The language L has names for every character and familial relations parent,child,sibling,grandparent,grandchild,cousin
    The knowledge-base Γ has axioms {sibling(Jack,Jill),sibling(x,y)sibling(y,x)}
    The deductive system ⊢ corresponds to first-order predicate logic.
    Alternatively, we could use a system (L,Γ,⊢), where
    The language L has names for every character and familial relations parent,child,sibling,grandparent,grandchild,cousin
    The knowledge-base Γ has axioms {sibling(Jack,Jill)}
    The deductive system ⊢ corresponds to first-order predicate logic with an additional logical rule sibling(x,y)⊢sibling(y,x).
    In this situation, we have two different SL models, and we want to ascribe beliefs to each of them. Consider the proposition ϕ that siblingness is symmetric, i.e. every person is the sibling of their siblings.
    Let's start with a black-box definition of knowledge or belief: when we say that a model knows or believes that ϕ, we mean that Γ⊢sibling(τ1,τ2)sibling(τ2,τ1) for every pair of closed L-terms τ1,τ2. According to this black...
    8 min
  • LW - continue working on hard alignment! don't give up! by carado
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: continue working on hard alignment! don't give up!, published by carado on March 24, 2023 on LessWrong.
    let's call "hard alignment" the ("orthodox") problem, historically worked on by MIRI, of preventing strong agentic AIs from pursuing things we don't care about by default and destroying everything of value to us on the way there. let's call "easy" alignment the set of perspectives where some of this model is wrong — some of the assumptions are relaxed — such that saving the world is easier or more likely to be the default.
    what should one be working on? as always, the calculation consists of comparing
    p(hard) × how much value we can get in hard
    p(easy) × how much value we can get in easy
    given how AI capabilities are going, it's not unreasonable for people to start playing their outs — that is to say, to start acting as if alignment is easy, because if it's not we're doomed anyways. but i think, in this particular case, this is wrong.
    this is the lesson of dying with dignity and bracing for the alignment tunnel: we should be cooperating with our counterfactual selves and continue to save the world in whatever way actually seems promising, rather than taking refuge in falsehood.
    to me, p(hard) is big enough, and my hard-compatible plan seems workable enough, that it makes sense for me to continue to work on it.
    let's not give up on the assumptions which are true. there is still work that can be done to actually generate some dignity under the assumptions that are actually true.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - We have to Upgrade by Jed McCaleb
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: We have to Upgrade, published by Jed McCaleb on March 23, 2023 on LessWrong.
    I want to bring up a point that I almost never hear talked about in AGI discussions. But to me feels like the only route for humans to have a good future. I’m putting this out for people that already largely share my view on the trajectory of AGI. If you don’t agree with the main premises but are interested, there are lots of other posts that go into why these might be true.
    A) AGI seems inevitable.
    B) Seems impossible that humans (as they are now) don’t lose control soon after AGI. All the arguments for us retaining control don’t seem to understand that AI isn’t just another tool. I haven’t seen any that grapple with what it really means for a machine to be intelligent.
    C) It seems very hard that AGI will be aligned with what humans care about. These systems are just so alien. Maybe we can align it for a little bit but it will be unstable. Very hard to see how alignment is maintained with a thing that is way smarter than us and is evolving on its own.
    D) Even if I’m wrong about B or C, humans are not intelligent/wise enough to deal with our current technology level, much less super powerful AI.
    Let's say we manage this incredibly difficult task of aligning or controlling AI to humans’ will. There are many amazing humans but also many many awful ones. The awful ones will continue to do awful things with way more leverage. This scenario seems pretty disastrous to me. We don’t want super powerful humans without an increase in wisdom.
    To me the conclusion from A+B+C+D is: There is no good outcome (for us) without humans themselves also becoming super intelligent.
    So I believe our goal should be to ensure humans are in control long enough to augment our mind with extra capability. (or upload but that seems further off) I’m not sure how this will work but I feel like the things that neuralink or science.xyz are doing, developing brain computer interfaces, are steps in that direction. We also need to figure out scalable technological ways to work on trauma/psychology/fulfilling needs/reducing fears. Humans will somehow have to connect with machines to become much wiser, much more intelligent, and much more enlightened. Maybe we can become something like the amygdala of the neo-neo-cortex.
    There are two important timelines in competition here, length of time till we can upgrade, and length of time we can maintain control. We need to upgrade before we lose control. Unfortunately, in my view, on the current trajectory we will lose control before we are able to upgrade. I think we must work to make sure this isn’t the case.
    Time Till Upgrade:
    My current estimate is ~15 years. (very big error bars here)
    Ways to shorten
    AI that helps people do this science
    AGI that is good at science and is aligned long enough to help us on this
    More people doing this kind of research
    More funding
    More status to this kind of research
    Maybe better interfaces to the current models will help in the short run and make people more productive thus speeding this development
    Time Left With Control:
    My current estimate is ~6 years
    AGI ~3-4 years (less big error bars)
    Loss of control 2-3 years after AGI (pretty big error bars)
    Ways it could be longer?
    AI research slows down
    Hope for safety
    Hope we aren’t as close as it seems
    Hope for a slowness to implement agentic behavior
    Competing Agents
    Alignment is pretty good and defense is easier than offense
    In short, one of the most underrepresented ways to work on AI safety is to work on BCI.
    The only way forward is through!
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • EA - The Overton Window widens: Examples of AI risk in the media by Akash
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: The Overton Window widens: Examples of AI risk in the media, published by Akash on March 23, 2023 on The Effective Altruism Forum.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    1 min
  • EA - Highlights from LPP’s field-building efforts by Legal Priorities Project
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Highlights from LPP’s field-building efforts, published by Legal Priorities Project on March 23, 2023 on The Effective Altruism Forum.
    Introduction
    The Legal Priorities Project (LPP) is dedicated to building a global community of people passionate about using the law to protect future generations and mitigate existential risk. Through our flagship programs—the Legal Priorities Summer Institute and the Summer Research Fellowship—participants gain hands-on experience and develop the skills needed to make a meaningful impact in this field. In this overview, you will learn more about what it's like to participate in these programs, what to expect afterward, and what other initiatives we’ve run. We are excited to share the work and accomplishments of our talented participants and look forward to hearing from you if you would like to get involved!
    Legal Priorities Summer Institute
    The Legal Priorities Summer Institute (LPSI) is an intensive, week-long program to introduce altruistically-minded law and policy students and early-career professionals to projects, theories, and tools relevant to tackling critical issues affecting the long-term future.
    LPSI is aimed primarily at individuals who want to learn about issues affecting the long-term future. Through a series of presentations, discussions, debates, and workshops, led by an array of experts, including government officials, academics, legal practitioners, philanthropists, and members of the judiciary, participants gain a better understanding of the current legal landscape and learn about the latest developments, trends, and best practices related to existential risk and global challenges.
    Despite the program being highly competitive, we strive to bring together individuals from various backgrounds, countries, cultures, disciplines, and professional experiences. We aim to create an environment that promotes open-mindedness and encourages participants to consider alternative perspectives.
    2022
    LPSI 2022 attracted 473 applicants from across the globe (227 undergrads, 160 master’s/JD, 65 PhD/JSD, and 21 others), with a significant number coming from top-ranked institutions—200 (42%) from the world’s top 20 law schools and 113 (24%) from the top 5 law schools. 402 (85%) applicants and 14 (40%) participants had very little or no previous exposure to longtermism.
    Thirty-five talented individuals were selected to participate in the program, representing eighteen countries and five continents, making the cohort extraordinarily diverse. You can meet our 2022 participants here.
    Program highlights
    A talk on “Reflections on Longtermist AI Governance Research from a Global South Perspective” by Cecil Abungu (Centre for the Study of Existential Risk, Legal Priorities Project).
    A discussion panel on AI governance with researchers from the Centre for the Study of Existential Risk.
    A talk on “Catastrophic Climate Change” by Goodwin Gibbins (Future of Humanity Institute).
    A career planning workshop with an advisor from 80,000 Hours.
    A talk on “Developing an Impact Litigation Strategy to Limit Catastrophic Biorisk” by Laurens Prins (Legal Priorities Project).
    Feedback from participants
    All feedback and testimonials were submitted anonymously right after the event.
    From 1 to 10, how likely is it that you would recommend the Institute to a colleague with similar interests to your own?
    9.1 / 10
    What was the most valuable experience from LPSI for you?
    LPSI gave me an opportunity to meet an amazing group of people. I met a group of people from the Global South, which has motivated all of us to bring forth Global South perspectives and collaborate on ways to bring these perspectives to the global avenue. Getting feedback and giving feedback to people was also a very valuable experience. It is impressive how much clarity you can get on ideas when...
    22 min