The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • EA - EA’s brain-over-body bias, and the embodied value problem in AI alignment by Geoffrey Miller
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: EA’s brain-over-body bias, and the embodied value problem in AI alignment, published by Geoffrey Miller on September 21, 2022 on The Effective Altruism Forum.
    Overview
    Most AI alignment research focuses on aligning AI systems with the human brain’s stated or revealed preferences. However, human bodies include dozens of organs, hundreds of cell types, and thousands of adaptations that can be viewed as having evolved, implicit, biological values, preferences, and priorities. Evolutionary biology and evolutionary medicine routinely analyze our bodies’ biological goals, fitness interests, and homeostatic mechanisms in terms of how they promote survival and reproduction. However the EA movement includes some ‘brain-over-body biases’ that often make our brains’ values more salient than our bodies’ values. This can lead to some distortions, blind spots, and failure modes in thinking about AI alignment. In this essay I’ll explore how AI alignment might benefit from thinking more explicitly and carefully about how to model our embodied values.
    Context: A bottom-up approach to the diversity of human values worth aligning with
    This essay is one in a series where I'm trying to develop an approach to AI alignment that’s more empirically grounded in psychology, medicine, and other behavioral and biological sciences. Typical AI alignment research takes a rather top-down, abstract, domain-general approach to modeling the human values that AI systems are supposed to align with. This often combines consequentialist moral philosophy as a normative framework, machine learning as a technical framework, and rational choice theory as a descriptive framework. In this top-down approach, we don’t really have to worry about the origins, nature, mechanisms, or adaptive functions of any specific values.
    My approach is more bottom-up, concrete, and domain-specific. I think we can’t solve the problem of aligning AI systems with human values unless we have a very fine-grained, nitty-gritty, psychologically realistic description of the whole range and depth of human values we’re trying to align with. Even if the top-down approach seems to work, and we think we’ve solved the general problem of AI alignment for any possible human values, we can’t be sure we’ve done that until we test it on the whole range of relevant values, and demonstrate alignment success across that test set – not just to the satisfaction of AI safety experts, but to the satisfaction of lawyers, regulators, investors, politicians, religious leaders, anti-AI activists, etc.
    Previous essays in this series addressed the heterogeneity of value types within individuals (8/16/2022, 12 min read), the heterogeneity of values across individuals (8/8/2022, 3 min read), and the distinctive challenges in aligning with religious values (8/15/2022, 13 min read). This essay addresses the distinctive challenges of aligning with body values – the values implicit in the many complex adaptations that constitute the human body. Future essays may address the distinctive challenges of AI alignment with political values, sexual values, family values, financial values, reputational values, aesthetic values, and other types of human values.
    The ideas in this essay are still rather messy and half-baked. The flow of ideas could probably be better organized. I look forward to your feedback, criticisms, extensions, and questions, so I can turn this essay into a more coherent and balanced argument.
    Introduction
    Should AI alignment research be concerned only with alignment to the human brain’s values, or should it also consider alignment with the human body’s values?
    AI alignment traditionally focuses on alignment with human values as carried in human brains, and as revealed by our stated and revealed preferences. But human bodies also embody evolved, adaptive,...
    45 min
  • LW - Understanding Infra-Bayesianism: A Beginner-Friendly Video Series by Jack Parker
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Understanding Infra-Bayesianism: A Beginner-Friendly Video Series, published by Jack Parker on September 22, 2022 on LessWrong.
    Click here to see the video series
    This video series was produced as part of a project through the 2022 SERI Summer Research Fellowship (SRF) under the mentorship of Diffractor.
    Epistemic effort: Before working on these videos, we spent ~400 collective hours working to understand infra-Bayesianism (IB) for ourselves. We built up our own understanding of IB primarily by working together on the original version of Infra-Exercises Part I and subsequently creating a polished version of the problem set in hopes of making it more user-friendly for others.
    We then spent ~320 hours writing, shooting, and editing this video series. Part 5 through Part 8 of the video series were checked for accuracy by Vanessa Kosoy, but any mistakes that remain in any of the videos are fully our own.
    Goals of this video series
    IB appears to have quite a bit of promise. It seems plausible that IB itself or some better framework that builds on and eventually replaces IB could end up playing a significant role in solving the alignment problem (although, as with every proposal in alignment, there is significant disagreement about this). But the original sequence of posts on IB appears to be accessible only to those with a graduate-level understanding of math. Even those with a graduate-level understanding of math would likely be well-served by first getting a gentle overview of IB before plunging into the technical details.
    When creating this video series, we had two audiences in mind. Some people just want to know what the heck infra-Bayesianism is at a high level and understand how it's supposed to help with alignment. We designed this video series to be a one-stop shop for accomplishing this goal. We hope that this will be the kind of video series where viewers won't ever have to pause a video and go do a search for some word or concept they didn't understand or that the video assumes knowledge of. To that end, the first four videos go over preliminary topics (which can definitely be skipped depending on how familiar the viewer already is with these topics). Here are the contents of the video series:
    Intro to Bayesianism
    Intro to Reinforcement Learning
    Intro to AIXI and Decision Theory
    Intro to Agent Foundations
    Vanessa Kosoy's Alignment Research Agenda
    Infra-Bayesianism
    Infra-Bayesian Physicalism
    Pre-DCA
    A Conversation with John Wentworth
    A Conversation with Diffractor
    A Conversation with Vanessa Kosoy
    We found that in order to explain IB effectively, we needed to show how IB is situated within Vanessa Kosoy's broader research agenda (which itself is situated within the agent foundations class of research agendas). We also wanted to give a concrete example of how IB could be applied to create a concrete protocol for alignment. Pre-DCA is such a protocol. It is very new and is changing quite rapidly as Vanessa tinkers with it more and more. By the time readers of this post watch the Pre-DCA video, it is likely that parts of it will already be out of date. That's perfectly fine. The purpose of the Pre-DCA video is purely to illustrate how one might go about leveraging IB to brainstorm a solution to alignment.
    Our second audience are those who want to gain mastery of the technical details behind IB so that they can apply it to their own alignment research. We hope that the video series will serve as a nice "base camp" for gaining a high-level understanding of IB before delving into more technical sources (such as Infra-Exercises Part I, the original sequence of posts on IB, or Vanessa's post on infra-Bayesian physicalism).
    Why videos?
    The primary reason that we chose to create videos instead of a written post is that video is a much more neglected medium for AI alignmen...
    5 min
  • EA - [Open position] S-Risk Community Manager at CLR by stefan.torges
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: [Open position] S-Risk Community Manager at CLR, published by stefan.torges on September 22, 2022 on The Effective Altruism Forum.
    The Center on Long-term Risk is looking for a Community Manager, to work with Chi Nguyen and me on growing and supporting the community around our mission of reducing risks of astronomical suffering. The application deadline is October 16th. Details and application form on our website here:/
    The work in this role will be across areas like event & project management, 1:1 outreach & advising calls, setting up & improving IT infrastructure, writing, giving talks, and attending in-person networking events – depending on the skill set of the successful candidate. Since we are a small team, each person can meaningfully shape our strategy, propose new ideas, and take ownership of projects early. They also have the chance to engage with our research team.
    Previous community-building experience is a good demonstration of the relevant skills, but no specific experience or qualifications are required.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Ukraine Post #12 by Zvi
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Ukraine Post #12, published by Zvi on September 22, 2022 on LessWrong.
    After doing frequent Ukraine posts early on, I decided that the war was no long a good match for this blog and my skill set. The basic situation was clear and was moving slowly. In the last few weeks things have started moving more rapidly on multiple fronts. Ukraine has made substantial progress.
    In response, Russia has begun substantial mobilization.
    Thus, it seems like it is worth writing another of these posts. I am not sure if events will justify any additional ones.
    Putin’s Speech
    In situations like this, one must watch the speech. I was later pointed to a transcript.
    Here are my notes as I watched. I cannot verify the translation but have no reason to doubt it that I can see.
    Putin initially frames this, even now, as about Donetsk and Lugansk only.
    However he then quickly names other ‘liberated’ regions and talks about the ‘security and territorial integrity’ of the regime – the ‘desire and will of our compatriots to choose their future independently’ (1:10)
    He claims West wants to split up the Russian Federation. Yes, well. (1:51)
    LNR/DNR units now considered on par with Russian units. (4:57)
    Clear intent to keep all territory Russia physically controls. (8:27)
    They will do this via ‘referendums’ in all these regions.
    Mobilization only of the reserves, promise of training. (10:00)
    Mobilization begins today, right now. (10:43)
    Defense industry tasked with ensuring there is equipment, promised support as needed. (11:17)
    Delivery of Western weapons that could ‘strike Crimea and Russia.’
    Claims that West is pushing Ukraine to invade Russia. (12:27)
    Accused West of ‘nuclear blackmail’ including weapons threats. (13:06)
    “In the event of a threat to the territorial integrity of the country, and to defend Russia and our people, we will certainly make use of all weapons systems available to us. This is not a bluff.”
    Emphasis on “By all the systems available to us.”
    Speech accused Ukraine and the West of various atrocities and other things as justification for all this.
    Speech does not mention how many troops are being called up. Many sources say 300,000. The speech neither limits that in any way, nor commits to doing anything that substantial.
    The references to industrial production being the responsibility of industry, aside from promises of financial support, seems like throwing industry under the bus. It is a useful thing to not interfere too much with industry. It is a different thing when you say they are ‘responsible’ for such matters while they lack the necessary inputs.
    Mike Ryan has an interesting close reading. He concludes that a lot of the speech is about preparing to blame others for failure. These are not measures one takes without accepting the possibility of losing.
    Close reading of Putin’s words is most important when it comes to nuclear weapons.
    Our Words Are Backed By Nuclear Weapons
    Russia threatening the West with nukes is nothing new at this point.
    Neither is Russian television continuously pushing anti-West, anti-American lines and calling for starting World War III.
    Putin explicitly threatening to use nukes to defend Ukrainian territory he has taken, however, does seem new.
    What exactly is he intending here? Is it a bluff? Here is one analysis.
    It is never a good sign when you are saying “this is not a bluff.”
    The first thing to notice is that the nightmare scenario, where Russia creates its sham Republics, annexes the Republics (potentially including territory it does not control) and then is willing to use nukes to defend them?
    That is a possible interpretation, which Putin is carefully ensuring one could hear if one wishes to do so. It is not what he is actually saying, or what he believes he will need to claim that he said in order to maintain credibility.
    Which is impor...
    27 min
  • EA - ETGP 2022: materials, feedback, and lessons for 2023 by trammell
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: ETGP 2022: materials, feedback, and lessons for 2023, published by trammell on September 22, 2022 on The Effective Altruism Forum.
    From August 20 to September 2, I ran a summer course in Oxford titled “Topics in Economic Theory and Global Prioritization”, or ETGP. It aimed to provide a rigorous introduction to a selection of topics in economic theory that appear especially relevant to the project of doing the most good. It was designed primarily for economics graduate students considering careers in global priorities research.
    The purpose of this post is to share
    the course materials as presented this year,
    the feedback, and
    a summary of the lessons learned.
    I hope it helps potential attendees get a better sense of whether they would like to attend next year, and potential organizers of similar programs get a better sense of whether and how to go about it.
    I’ve erred on the side of thoroughness regarding the feedback and lessons learned. A brief summary is that the course was rated very highly, and that I think this suggests people should consider organizing more structured courses, instead of sticking to the more common “EA formula” of reading groups and summer research fellowships.
    The course was sponsored by Forethought and made possible by operations support from the Global Priorities Institute. If you would like to be notified when applications open for next year, email me at [email protected].
    Course materials and program schedule
    The lecture slides and exercises, as presented this year (with corrections), can be found here. Feel free to use them for any purpose.
    The program was scheduled as follows:
    Saturday, August 20 - Sunday, August 21: two 1.5h lectures per day on philosophical and mathematical background material, respectively.
    Monday, August 22 - Friday, August 26: two 1.5h lectures per day on various EA-relevant macroeconomic theory topics.
    Saturday, August 27: (optional) punting in the afternoon.
    Monday, August 29 - Friday, September 2: two 1.5h lectures per day on various EA-relevant microeconomic theory topics.
    Attendees were given the option to stay for a (totally unstructured) third week to discuss research ideas with each other, schedule meetings with others in Oxford, and so on.
    The lectures, except for those on the first day, came with exercises. Every lecture-day except the first two (August 20-21) opened with a 1-hour session in which I went over previous lecture-day’s exercises. They were not graded.
    Lectures and lunches were held at Trajan House, where GPI and Forethought are based. Breakfasts, dinners, and housing were held at Worcester College, Oxford, except for an opening dinner and a closing dinner, which were held at pubs.
    Applicant and attendee characteristics
    There were 179 applicants. 46 were accepted (26%), and 34 attended at least in part.
    Educational backgrounds of the attendees:
    1 was an assistant professor of economics (3%)
    16 were enrolled in, or about to begin, doctoral programs in economics (47%)
    3 were enrolled in or about to begin master’s programs in economics, or recent graduates of master’s programs not doing either of the above (9%)
    6 were doing pre-doctoral research / research assistance in economics (18%)
    6 were undergraduates studying economics, or recent graduates not doing any of the above (18%)
    2 had never pursued an economics degree (6%). (One had a graduate degree in a related field, and the other was pursuing one)
    Genders of the attendees:
    29 were male (85%)
    5 were female (15%)
    45 of the applicants (25%) and 9 of the admits (20%) were female. I noticed the relative scarcity of female applicants when reviewing the applications, and I did my best to ensure that they were not rejected unfairly.
    Feedback
    The feedback survey received 24 responses (71%). Aggregate results are as follows:
    Overall eva...
    13 min
  • EA - The Hundred Billion Dollar Opportunity that EAs mostly ignore by JeremiahJohnson
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: The Hundred Billion Dollar Opportunity that EAs mostly ignore, published by JeremiahJohnson on September 22, 2022 on The Effective Altruism Forum.
    Epistemic Status: Relatively confident but also willing to take advantage of Cunningham's Law if I'm wrong. May lack deep knowledge of EA efforts in this area.
    About me:
    I'm a sometime EA and looking to dive into the EA world more fully, including potentially shifting my career to work in EA. I currently work in US politics and specialize in online movement building and communications. I trend towards near-termist and global health EA causes, although I think the argument below also has long-termist implications.
    The Central Premise
    There is a potentially massive method of doing good out there that's mostly ignored.
    This method is at the absolute heart of the very concept of Effective Altruism, and yet is rarely discussed in EA communities or spaces.
    We should try harder to influence the average non-EA person's donation.
    The Current Charitable Landscape
    A few quick facts: The United States donated almost $500 billion just in 2021. Without listing every individual country, European charitable donations are on the scale of hundreds of billions as well. Overall, yearly charitable donations in rich countries worldwide are in the high hundreds of billions of USD.
    Most of this money, from an EA perspective, is wildly inefficiently spent. While it's impossible to break down exactly where each of these dollars goes, a little bit of common sense and some basic statistics paints a discouraging picture. Of this giant pile of money, only 6% is donated internationally, despite donations to poor countries usually having a better per-dollar impact than donations inside a rich country. The largest categories for donation are religious organizations. The second largest category is educational donations. Three quarters of that educational money is given to existing 4-year colleges and universities. Much of that is the stereotypical worst kind of donation, a huge donation to an elite school that already has billions in endowment.
    Beyond the statistics, any casual glance at how normal people donate their money can confirm this. People give to local schools, their friend's charity, or generally whatever they feel a connection to. My parents, who are highly charitable people who gave >10% of their income long before it was an EA idea, have made significant charitable donations to a children's puppetry program. This is the landscape in which the better part of a trillion dollars is being spent.
    None of this should be surprising to EAs. The core of Effective Altruism is the argument that when you attempt to do good, you should try to be effective in doing so. The equally core fact about the world that EAs recognize is that historically, most people have not been very good at maximizing how much good they do. For the vast majority of charitable dollars, that's still true.
    The Argument for Impact
    I believe Effective Altruism should spend more time trying to shift the behavior of the general public. I believe this area has the potential for large impact, and that it's currently neglected as a way to do good.
    Scale - Enormous. Not going to spend much time on this point, but obviously changes to how hundreds of billions of charitable dollars are given would be huge in scale.
    Tractability - This problem is likely more difficult and less tractable than many other cause areas. It's very difficult to simply spin wide-ranging cultural changes into existence. But it's not impossible, and the enormous size of the pile of money mitigates the low tractability. Using some relatively low numbers - If you had even a 1% chance of success, and success meant only shifting 5% of US charitable dollars, that's still 250 million dollars of donations going to more effect...
    12 min
  • LW - Scraping training data for your mind by Henrik Karlsson
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Scraping training data for your mind, published by Henrik Karlsson on September 21, 2022 on LessWrong.
    2432 pages into Karl Ove Knausgaard’s autobiographical My Struggle comes a pivotal plot point: the publication of a new Proust translation in Norwegian.
    Knausgaard at this point, in his mid-twenties, has spent nearly ten years learning to write. Without success, to put it mildly. His best friend, Tore Renberg, having read the results, in one scene comes over to Knausgaard’s flat, looking a little as if he has been drinking before he arrived to work up his nerve.
    “But Karl Ove”, Renberg says about his writing, “there is. nothing there”.
    This isn’t the first time we’ve seen how people react to Knausgaard’s prose. Earlier in the book, when he is working as a teacher in a remote fishing village in northern Norway, Knausgaard comes home to find his colleagues laughing while reading a sex scene he’s written. Knausgaard—still a virgin—walks straight through the kitchen into his study, where he downs a full bottle of wine in one go and proceeds to throw up all over the bookcase.
    But Renberg’s criticism cuts deeper. Renberg, who is younger than Knausgaard, has already become an accomplished writer and knows what he’s talking about. There really is nothing there.
    So Knausgaard stops writing. When the new translation of Prouts’s In Search of Lost Time is published he has not written for two years. In the spring light, he reads Proust’s memoirs, all seven of them, in one big gulp like “drinking a glass of water”. He has said it was like “visiting a wood you have been in before, a long time ago . . . and when you start walking, the memories start coming back”.
    After that epiphany . . . he spends another two years not writing. That is about 200 pages of his autobiography.
    Then, for inexplicable reasons, an editor at Tiden, a subsidiary of Norway’s biggest publishing house, an editor who, like everyone else, is unconvinced by Knausgaard’s writing, decides that, well, why not give him a book deal anyway. Knausgaard abandons everything, moves back to his mother’s town, Arendal, and sets out to write a debut novel. He doesn’t know what to write about. He overhears a conversation in the library, writes it down, and then wings it from there.
    The novel turns into a story about a 26-year-old teacher, Henrik Vankel. Like many debuts, it is hard to not read as autobiographical—which becomes all the tenser as the plot centers on the sexual relationship Vankel has with his 13-year-old pupil Miriam in a small fishing village identical to the one where Knausgaard taught in northern Norway. The book was an immediate critical and financial success.
    One reason for the success was that the writing is pure Proust. Coursing through every sentence of Ude af verden, like a virus, is the Proustian sensibility, the obsession with time and memory, the rich and clear language. Knausgaard claims he wasn’t aware of the influence at the time—but something about The Search for Lost Time had worked itself into him, rearranging his sensibilities. Over the two years when he did not write, his writing had transformed.
    This is quite common for writers. Reading something powerful, the voice infects them. Sometimes this is a weakness, if the influence has not been transformed into something personal. But there is also no way around it: finding good influences is a prerequisite for writing well.
    Some writers do this very deliberately. Werner Herzog will spend days reading the Poetic Edda and listening to classical music at full volume to get himself into what he calls an “ecstasy of language” before writing a script. John Frusciante, as we discussed in the last part of this series, does something similar when writing songs.
    Let’s call this scraping good training data for your mind. It is an important skill. Too often...
    14 min
  • LW - LW Petrov Day 2022 (Monday, 9/26) by Ruby
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: LW Petrov Day 2022 (Monday, 9/26), published by Ruby on September 22, 2022 on LessWrong.
    Next Monday is Petrov Day (September 26), an annually observed Rationalist/EA holiday inspired by the actions of Stanislav Petrov:
    As a Lieutenant Colonel of the Soviet Army, Petrov manned the system built to detect whether the US government had fired nuclear weapons on Russia. On September 26th, 1983, the system reported five incoming missiles. Petrov’s job was to report this as an attack to his superiors, who would launch a retaliative nuclear response. But instead, contrary to the evidence the systems were giving him, he called it in as a false alarm.
    It was subsequently determined that the false alarms were caused by a rare alignment of sunlight on high-altitude clouds and the satellites' Molniya orbits, an error later corrected by cross-referencing a geostationary satellite.
    In explaining the factors leading to his decision, Petrov cited his belief and training that any U.S. first strike would be massive, so five missiles seemed an illogical start.
    Petrov underwent intense questioning by his superiors about his actions. Initially, he was praised for his decision. Petrov himself stated he was initially praised by Votintsev and was promised a reward, but recalled that he was also reprimanded for improper filing of paperwork with the pretext that he had not described the incident in the military diary.
    He received no reward. According to Petrov, this was because the incident and other bugs found in the missile detection system embarrassed his superiors and the influential scientists who were responsible for it, so that if he had been officially rewarded, they would have had to be punished. He was reassigned to a less sensitive post, took early retirement (although he emphasized that he was not "forced out" of the army, as is sometimes claimed by Western sources), and suffered a nervous breakdown.
    For more information see 1983 Soviet nuclear false alarm incident
    Each year, people find ways to commemorate Petrov Day, e.g. with this ceremony written by Jim Babcock or Raemon's Modes of Petrov Day.
    On LessWrong, we find our own way to celebrate, generally involving a large red button that brings down the frontpage for the duration of Petrov Day.
    What does Petrov Day celebrate?
    There isn't a canonical precise answer accepted by everyone. There's a cluster of virtues and actions that people find worthy of remembering with different degrees of emphasis. These include:
    Not doing things that would cause immense destruction (or the end of the world)
    Avoiding the dangers of unrestrained escalation
    Not taking unilateralist action
    Resisting social pressures in order to do the right thing
    Making the right decision even in the face of uncertainty
    You might even say part of the Petrov Day tradition is debating which virtues Stanislav Petrov displayed and which ones we ought to celebrate. Personally, I like the underlying simple theme of "someone was in a high-stakes situation where they could have chosen a destructive path, and they didn't" and "things were close, but we survived". As far as the LessWrong celebration goes, each year I like the idea of exploring a different sub-element of surviving high-stakes scenarios and the virtues required to do so. This brings us to this year's plans...
    The 2022 Plan
    This is what I'm thinking:
    Every user with an existing LessWrong account (created before 2022-09-21) and non-negative karma is able to participate. We may manually exclude some known historical troublemakers.
    Your actions will be anonymous, including to the LessWrong team. This is a major change from last year. If you act counter to what other people think you should do, you'll only have to live with your own self-judgment and the mental simulation of others :P
    There is a virtue in preventing ...
    8 min
  • EA - Summarizing the comments on William MacAskill's NYT opinion piece on longtermism by West
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Summarizing the comments on William MacAskill's NYT opinion piece on longtermism, published by West on September 21, 2022 on The Effective Altruism Forum.
    We are a small community, but our ideas have the potential to spread far if communicated effectively. Refining our communication means being well calibrated as to how people outside the EA community react to our worldviews. So when MacAskill's article about longtermism was published last month in the NYT, I was pretty interested to see the comment section. I started to count various reactions, got carried away, and ended up going through 300 or so. Below is a numerical summary.
    Caveats
    Selection bias is present. I would guess NYT commenters skew older and liberal.
    It's possible the comments don't reflect overall sentiment of the article's readers, because people might only feel compelled to comment when they are strongly skeptical, undercounting casually positive readers.
    Many people signaled they felt positive towards the article and longtermist thinking, but were entirely pessimistic about our future -- basically "This is all well and good, but _". Sometimes it was hard to know whether to tally these as positive or skeptical; I usually went with whichever sentiment was the main focus of the comment.
    For the most part, this survey doesn't capture ideas people had to help our long term future. Some of those not tallied included better education, fusion power, planting trees, and outlawing social media.
    Tallies
    60 - Skeptical -- either of longtermism, or our future
    20 - Our broken culture prevents us from focusing on the long-term
    16 - We're completely doomed, there's no point
    7 - We are hard-wired as animals to think short term
    7 - Predicting the future is hard; made up numbers
    5 - We don't know what future generations will want
    5 - We don't even value current lives
    3 - I value potential people far less than current people
    3 - It's easy to do horrific things in the name of longtermism
    2 - This is ivory tower BS
    42 - Generally positive
    17 - This is nothing new (most of these comments were either about climate activism or seven generation sustainability)
    7 - This planet is not ours / humans don't deserve to survive
    7 - We should lower the population
    6 - This is all about environmental sustainability
    6 - Animals matter too
    5 - Republicans are terrible
    4 - Reincarnation might be true
    3 - We should ease up on technology
    2 - Technology will save us
    1 - Time travel might be true
    1 - Society using carbon is a good thing
    1 - This idea is un-American
    1 - This is all the fault of boomers
    1 - Stop blaming boomers
    Takeaways
    Overall, I found the responses to be more negative than anticipated. The most common sentiment I saw was utter pessimism, which I worry is a self-fulling prophecy.
    There was very little reaction to or discussion about the risks of bioweapons and AI. Many people seemed to substitute concern for our long-term future solely with concern for the environment. This is understandable given the prominence of environmentalism -- it's already top-of-mind for many.
    I think people struggled to appreciate the timescale proposed in the article. Many referenced leaving the Earth a better place for their (literal) grandchildren, or for seven generations from now, but not thousands of years.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • AF - Announcing AISIC 2022 - the AI Safety Israel Conference, October 19-20 by David Manheim
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Announcing AISIC 2022 - the AI Safety Israel Conference, October 19-20, published by David Manheim on September 21, 2022 on The AI Alignment Forum.
    ALTER, with the University of Haifa and the Technion, is excited to announce the details about its upcoming conference introducing AI safety in Israel. We’re going to be hosting Stuart Russell, as well as several other AI safety researchers, to speak about the field. We're also hosting a number of Israeli academics, who will speak about their related research.
    The goal of the conference is to build a community of interest around AI safety in Israel, let people know about the field, and following up on the conference, we hope to connect interested attendees with work going on internationally. (This is not intended to be a conference where novel AI safety work is presented, and the primary audience is people who would otherwise be working on AI capabilities research.)If you are, or know anyone who is interested in AI safety in Israel, we would be happy for them to register and attend!
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min