The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • EA - Takeaways from the Metaculus AI Progress Tournament by Javier Prieto
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Takeaways from the Metaculus AI Progress Tournament, published by Javier Prieto on July 27, 2023 on The Effective Altruism Forum.
    In 2019, Open Philanthropy commissioned a set of forecasts on AI progress from Metaculus. The forecasting questions had time horizons between 6 months and >6 years. As of June 2023, 69 of the 111 questions had been resolved unambiguously. In this post, I analyze the accuracy of these forecasts as a function of question (sub)category, crowd size, and forecasting horizon. Unless otherwise indicated, my analyses are about Metaculus' proprietary aggregate forecast ("the Metaculus prediction") evaluated at the time the question closed.
    Related work
    Feel free to skip to the next section if you're already familiar with these analyses.
    This analysis published 2 years ago (July 2021) looked at 64 resolved AI questions and concluded there was weak but ultimately inconclusive evidence of bias towards faster progress.
    A more recent analysis from March 2023 found that Metaculus had a worse Brier score on (some) AI questions than on average across all questions and presented a few behavioral correlates of accuracy within AI questions, e.g. accuracy was poorer on questions with more updates and when those updates were less informative in a certain technical sense (see post for details).
    Metaculus responded to the previous post with a more comprehensive analysis that included all resolved AI questions (152 in total, 64 of which were binary and 88 continuous). They show that performance is significantly better than chance for both question types and marginally better than was claimed in the previous analysis (which relied on a smaller sample of questions), though still worse than the average for all questions on the site.
    The analysis I present below has some overlaps with those three but it fills an important gap by studying whether there's systematic over- or under-optimism in Metaculus's AI progress predictions using data from a fairly recent tournament that had monetary incentives and thus (presumably) should've resulted in more careful forecasts.
    Key takeaways
    NB: These results haven't been thoroughly vetted by anyone else. The conclusions I draw represent my views, not Open Phil's.
    Progress on benchmarks was underestimated, while progress on other proxies (compute, bibliometric indicators, and, to a lesser extent, economic indicators) was overestimated. [more]
    This is consistent with a picture where AI progresses surprisingly rapidly on well-defined benchmarks but the attention it receives and its "real world" impact fail to keep up with performance on said benchmarks.
    However, I see a few problems with this picture:
    It's unclear to me how some of the non-benchmark proxies are relevant to AI progress, e.g.
    The TOP500 compute benchmark is mostly about supercomputers that (AFAICT) are mostly used to run numerical simulations, not to accelerate AI training and inference. In fact, some of the top performers don't even have GPUs.
    The number of new preprints in certain ML subfields over short (~6-month) time horizons may be more dependent on conference publication cycles than underlying growth.
    Most of these forecasts came due before or very soon after the release of ChatGPT and GPT-4 / Bing, a time that felt qualitatively different from where we are today.
    Metaculus narrowly beats chance and performs worse in this tournament than on average across all continuous questions on the site despite the prize money. This could indicate that these questions are inherently harder, or that they drove less or lower-quality engagement. [more]
    There's no strong evidence that performance was significantly worse on questions with longer horizons (<1 year vs ~2 years). [more]
    I see no clear pattern behind the biggest misses, but I provide plausible post-mortems for some o...
    11 min
  • EA - Partial Transcript of Recent Senate Hearing Discussing AI X-Risk by Daniel Eth
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Partial Transcript of Recent Senate Hearing Discussing AI X-Risk, published by Daniel Eth on July 27, 2023 on The Effective Altruism Forum.
    On Tuesday, the US Senate Judiciary Subcommittee on Privacy, Technology and the Law held a hearing on AI. The hearing involved 3 witnesses - Dario Amodei (CEO of Anthropic), Yoshua Bengio (Turing Award winner, and the second-most cited AI researcher in the world), and Stuart Russell (Professor of CS at Berkeley, and co-author of the standard textbook for AI).
    The hearing wound up focusing a surprising amount on AI X-risk and related topics. I originally planned on jotting down all the quotes related to these topics, thinking it would make for a short post of a handful of quotes, which is something I did for a similar hearing by the same subcommittee 2 months ago. Instead, this hearing focused so much on these topics that I wound up with something that's better described as a partial transcript.
    All the quotes below are verbatim. Text that is bolded is simply stuff I thought readers might find particularly interesting. If you want to listen to the hearing, you can do so here (it's around 2.5 hours). You might also find it interesting to compare this post to the one from 2 months ago, to see how the discourse has progressed.
    Opening remarks
    Senator Blumenthal:
    What I have heard [from the public after the last AI hearing] again and again and again, and the word that has been used so repeatedly is 'scary.' 'Scary'. What rivets [the public's] attention is the science-fiction image of an intelligence device, out of control, autonomous, self-replicating, potentially creating diseases - pandemic-grade viruses, or other kinds of evils, purposely engineered by people or simply the result of mistakes. And, frankly, the nightmares are reinforced in a way by the testimony that I've read from each of you.
    I think you have provided objective, fact-based views on what the dangers are, and the risks and potentially even human extinction - an existential threat which has been mentioned by many more than just the three of you, experts who know first hand the potential for harm. But these fears need to be addressed, and I think can be addressed through many of the suggestions that you are making to us and others as well.
    I've come to the conclusion that we need some kind of regulatory agency, but not just a reactive body. actually investing proactively in research, so that we develop countermeasures against the kind of autonomous, out-of-control scenarios that are potential dangers: an artificial intelligence device that is in effect programmed to resist any turning off, a decision by AI to begin nuclear reaction to a nonexistent attack.
    The White House certainly has recognized the urgency with a historic meeting of the seven major companies which made eight profoundly significant commitments. but it's only a start. The urgency here demands action.
    The future is not science fiction or fantasy - it's not even the future, it's here and now. And a number of you have put the timeline at 2 years before we see some of the biological most severe dangers. It may be shorter because the kinds of pace of development is not only stunningly fast, it is also accelerated at a stunning pace, because of the quantity of chips, the speed of chips, the effectiveness of algorithms. It is an inexorable flow of development.
    Building on our previous hearing, I think there are core standards that we are building bipartisan consensus around. And I welcome hearing from many others on these potential rules:
    Establishing a licensing regime for companies that are engaged in high-risk AI development;
    A testing and auditing regimen by objective 3rd parties or by preferably the new entity that we will establish;
    Imposing legal limits on certain uses related to elections. related to...
    33 min
  • EA - CE: Announcing our February 2024 Charity Ideas. Apply now! by CE
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: CE: Announcing our February 2024 Charity Ideas. Apply now!, published by CE on July 27, 2023 on The Effective Altruism Forum.
    Join our February-March 2024 Incubation Program to start nonprofits in Mass Media (Global Health) and Animal Welfare.
    In this post, we announce our top four charity ideas to launch in February 2024. They are the results of months of work by our research team, who selected them through a seven-stage research process. We pick interventions that exceed ambitious cost-effectiveness bars (e.g., for global health policy, this is 5x top GiveWell evaluated charities), have a high quality of evidence, minimal failure modes, and high expected value.
    We're seeking people to launch these ideas through our February-March 2024 Incubation Program. No particular previous experience is necessary - if you could plausibly see yourself excited to launch one of these charities, we encourage you to apply. The deadline for applications is September 30, 2024.
    In the Incubation Program, we provide two months of cost-covered training, stipends, funding up to $200,000, operational support in your first months, a co-working space at our CE office in London, ongoing mentorship, and access to a community of alumni, funders, and experts. Learn more on our refreshed CE Incubation Program page.
    Disclaimer:
    To be brief, we have sacrificed nuance, the details of our considerable uncertainties, and the downside risks discussed in the extended reports. Full reports will be published on our website and the EA Forum and announced in our newsletter in the upcoming weeks.
    Please note that previous incubatees attest to the ideas becoming increasingly exciting over the course of the program.
    One-Sentence SummariesChildhood vaccination reminders
    An organization that sends SMS or voice messages to remind caregivers to attend their child's vaccination appointments.
    Mass media to prevent violence against women
    A non-profit that produces and delivers educational entertainment content focusing on preventing intimate partner violence.
    Influencing EU fish welfare policy through strategic work in Greece
    An organization focused on improving fish welfare through corporate campaigning and policy work in Greece, aiming to influence animal welfare standards at the EU level.
    Influencing key stakeholders of the emerging insect industry
    An organization that provides information to relevant stakeholders on sustainability, environmental impacts, food safety concerns, and animal welfare issues related to insect farming.
    One-Paragraph Summaries
    Childhood vaccination reminders
    In 2021, 25 million children under one went unvaccinated. Studies show that mobile messages can effectively remind caregivers to keep up with their child's vaccination schedule, thereby mitigating disease risk and improving overall health outcomes (1, 2, 3). Yet, such beneficial services are rarely implemented on a large scale. Suvita, a non-profit incubated by CE, is delivering this impactful service in India. A new non-profit organization will launch it in the next top-priority country. This new organization will likely coordinate closely with Suvita to expand to numerous priority countries or operate under the same umbrella. This intervention can be expected to help avert one disability-adjusted life year (DALY) for approximately $80, making it a highly cost-effective means to improve global health.
    Mass media to prevent violence against women
    Almost 500 million women aged 15 to 49 have been subjected to violence from an intimate partner at least once since they turned 15. Countless women continually face threats to their safety within their homes, experiencing physical, sexual, and emotional abuse. Fueled by societal norms and attitudes, this pervasive form of violence remains prevalent in many societies worldwide. Evidence from r...
    19 min
  • LW - Cultivating a state of mind where new ideas are born by Henrik Karlsson
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Cultivating a state of mind where new ideas are born, published by Henrik Karlsson on July 27, 2023 on LessWrong.
    In the early 2010s, a popular idea was to provide coworking spaces and shared living to people who were building startups. That way the founders would have a thriving social scene of peers to percolate ideas with as they figured out how to build and scale a venture. This was attempted thousands of times by different startup incubators. There are no famous success stories.
    In 2015, Sam Altman, who was at the time the president of Y Combinator, a startup accelerator that has helped scale startups collectively worth $600 billion, tweeted in reaction that "not [providing coworking spaces] is part of what makes YC work." Later, in a 2019 interview with Tyler Cowen, Altman was asked to explain why.
    SAM ALTMAN: Good ideas - actually, no, great ideas are fragile. Great ideas are easy to kill. An idea in its larval stage - all the best ideas when I first heard them sound bad. And all of us, myself included, are much more affected by what other people think of us and our ideas than we like to admit.
    If you are just four people in your own door, and you have an idea that sounds bad but is great, you can keep that self-delusion going. If you're in a coworking space, people laugh at you, and no one wants to be the kid picked last at recess. So you change your idea to something that sounds plausible but is never going to matter. It's true that coworking spaces do kill off the very worst ideas, but a band-pass filter for startups is a terrible thing because they kill off the best ideas, too.
    This is an insight that has been repeated by artists, too. Pablo Picasso: "Without great solitude, no serious work is possible." James Baldwin: "Perhaps the primary distinction of the artist is that he must actively cultivate that state which most men, necessarily, must avoid: the state of being alone." Bob Dylan: "To be creative you've got to be unsociable and tight-assed."
    When expressed in aphorisms like this, you almost get the impression that creativity simply requires that you sit down in a room of your own. In practice, however, what they are referring to as solitude is rather something like "a state of mind." They are putting themselves in a state where the opinions of others do not bother them and where they reach a heightened sensitivity for the larval ideas and vague questions that arise within them.
    To get a more visceral and nuanced understanding of this state, I've been reading the working notes of several highly creative individuals. These notes, written not for publication but as an aid in the process of discovery, are, in a way, partial windows into minds who inhabit the solitary creative space which the quotes above point to. In particular, I've found the notes of the mathematician Alexander Grothendieck and the film director Ingmar Bergman revealing. They both kept detailed track of their thoughts as they attempted to reach out toward new ideas. Or rather, invited them in. In the notes, they also repeatedly turned their probing thoughts onto themselves, trying to uncover the process that brings the new into the world.
    This essay is not a definite description of this creative state, which takes on many shapes; my aim is rather to give a portrait of a few approaches, to point out possibilities.
    Part 1: Alexander Grothendieck
    It is as if there existed, for what seems like millennia, tracing back to the very origins of mathematics and of other arts and sciences, a sort of "conspiracy of silence" surrounding [the] "unspeakable labors" which precede the birth of each new idea, both big and small[.]
    Alexander Grothendieck, Récoltes et Semailles
    In June 1983, Alexander Grothendieck sits down to write the preface to a mathematical manuscript called Pursuing Stacks. He is c...
    22 min
  • LW - Cultivating a state of mind where new ideas are born by Henrik Karlsson
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Cultivating a state of mind where new ideas are born, published by Henrik Karlsson on July 27, 2023 on LessWrong.
    In the early 2010s, a popular idea was to provide coworking spaces and shared living to people who were building startups. That way the founders would have a thriving social scene of peers to percolate ideas with as they figured out how to build and scale a venture. This was attempted thousands of times by different startup incubators. There are no famous success stories.
    In 2015, Sam Altman, who was at the time the president of Y Combinator, a startup accelerator that has helped scale startups collectively worth $600 billion, tweeted in reaction that "not [providing coworking spaces] is part of what makes YC work." Later, in a 2019 interview with Tyler Cowen, Altman was asked to explain why.
    SAM ALTMAN: Good ideas - actually, no, great ideas are fragile. Great ideas are easy to kill. An idea in its larval stage - all the best ideas when I first heard them sound bad. And all of us, myself included, are much more affected by what other people think of us and our ideas than we like to admit.
    If you are just four people in your own door, and you have an idea that sounds bad but is great, you can keep that self-delusion going. If you're in a coworking space, people laugh at you, and no one wants to be the kid picked last at recess. So you change your idea to something that sounds plausible but is never going to matter. It's true that coworking spaces do kill off the very worst ideas, but a band-pass filter for startups is a terrible thing because they kill off the best ideas, too.
    This is an insight that has been repeated by artists, too. Pablo Picasso: "Without great solitude, no serious work is possible." James Baldwin: "Perhaps the primary distinction of the artist is that he must actively cultivate that state which most men, necessarily, must avoid: the state of being alone." Bob Dylan: "To be creative you've got to be unsociable and tight-assed."
    When expressed in aphorisms like this, you almost get the impression that creativity simply requires that you sit down in a room of your own. In practice, however, what they are referring to as solitude is rather something like "a state of mind." They are putting themselves in a state where the opinions of others do not bother them and where they reach a heightened sensitivity for the larval ideas and vague questions that arise within them.
    To get a more visceral and nuanced understanding of this state, I've been reading the working notes of several highly creative individuals. These notes, written not for publication but as an aid in the process of discovery, are, in a way, partial windows into minds who inhabit the solitary creative space which the quotes above point to. In particular, I've found the notes of the mathematician Alexander Grothendieck and the film director Ingmar Bergman revealing. They both kept detailed track of their thoughts as they attempted to reach out toward new ideas. Or rather, invited them in. In the notes, they also repeatedly turned their probing thoughts onto themselves, trying to uncover the process that brings the new into the world.
    This essay is not a definite description of this creative state, which takes on many shapes; my aim is rather to give a portrait of a few approaches, to point out possibilities.
    Part 1: Alexander Grothendieck
    It is as if there existed, for what seems like millennia, tracing back to the very origins of mathematics and of other arts and sciences, a sort of "conspiracy of silence" surrounding [the] "unspeakable labors" which precede the birth of each new idea, both big and small[.]
    Alexander Grothendieck, Récoltes et Semailles
    In June 1983, Alexander Grothendieck sits down to write the preface to a mathematical manuscript called Pursuing Stacks. He is c...
    22 min
  • EA - Apply to CEEALAR to do AGI moratorium work by Greg Colbourn
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Apply to CEEALAR to do AGI moratorium work, published by Greg Colbourn on July 27, 2023 on The Effective Altruism Forum.
    Do you have short AI timelines and/or p(doom|AGI) that is far too high for comfort? Do you want to pivot to working on directly addressing the problem and lowering all of our p(doom)s by slowing down or pausing AGI development? Is lack of funding/runway holding you back?
    This is an invitation for people to apply to CEEALAR for a grant (of free accommodation, food and stipend) to work towards getting a global moratorium on AGI implemented. Such work may take the form of organising public campaigns, such as letter writing, petitions, protests, social media posts, ads etc, drafting of relevant policies or regulatory frameworks (e.g. how to implement caps on training runs), or meta work organising and fundraising for such activities.
    We've already had one grantee stay who's working in the space, and I (Founder and Executive Director) am very interested in the area, having recently (post-GPT-4) elevated it to a top priority of mine.
    Active discussion spaces for those working in the area include the AGI Moratorium HQ Slack and the PauseAI Discord. Various projects are being organised within them.
    Orgs already in the space that may have projects you can get involved with, include: PauseAI, Campaign for AI Safety, Stop AGI, Centre for AI Policy, Stakeout AI, Centre for AI Safety, Future of Life Institute.
    Given we (CEEALAR) are a (UK) charity, we have to be mindful of not being too overtly political, or ensuring that any political activity is furthering our charitable objects. This means not being partisan by singling out individual political parties or politicians for criticism, or being needlessly provocative. Think public awareness raising, public education and encouragement of civic responsibility over the issue, similar to how many charities focused on climate campaigning operate (e.g. the Climate Coalition).
    I look forward to your applications and hope that we can hereby accelerate meaningful action toward a global moratorium on AGI.
    Following charitable object 3, "To advance such other purposes which are exclusively charitable according to the law in England and Wales", your work would need to fit in with the Charitable Purposes under UK law listed here. For practical purposes, preventing human extinction from AGI would come under "saving of lives".
    For example, any protests being organised should require people to abide by this code of conduct.
    We reserve the right to withdraw funding to anyone who doesn't work within our charitable objects or who's work may risk damage to our reputation.
    We are also still very much accepting general applications for any EA-related work/career development.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org
    3 min
  • LW - The First Room-Temperature Ambient-Pressure Superconductor by Annapurna
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: The First Room-Temperature Ambient-Pressure Superconductor, published by Annapurna on July 26, 2023 on LessWrong.
    From the post:
    For the first time in the world, we succeeded in synthesizing the room-temperature superconductor ( K, 127C) working at ambient pressure with a modified lead-apatite (LK-99) structure. The superconductivity of LK-99 is proved with the Critical temperature (), Zero-resistivity, Critical current (), Critical magnetic field (), and the Meissner effect. The superconductivity of LK-99 originates from minute structural distortion by a slight volume shrinkage (0.48 %), not by external factors such as temperature and pressure. The shrinkage is caused by Cu substitution of Pb(2) ions in the insulating network of Pb(2)-phosphate and it generates the stress. It concurrently transfers to Pb(1) of the cylindrical column resulting in distortion of the cylindrical column interface, which creates superconducting quantum wells (SQWs) in the interface. The heat capacity results indicated that the new model is suitable for explaining the superconductivity of LK-99.
    The unique structure of LK-99 that allows the minute distorted structure to be maintained in the interfaces is the most important factor that LK-99 maintains and exhibits superconductivity at room temperatures and ambient pressure.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Llama We Doing This Again? by Zvi
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Llama We Doing This Again?, published by Zvi on July 26, 2023 on LessWrong.
    I've finally had an opportunity to gather the available information about Llama-2 and take an in-depth look at the system card.
    My conclusion is that Llama-2 looks to score about 3.4 GPTs, with coding as its relative weak point. The system card tries to claim better performance than that in some places in rather misleading fashion, but in other places it does not make such claims.
    For its intended purposes it is now the best open source model, while remaining well behind closed source models. There is substantial improvement over Llama-1 in capabilities, it comes with fine tuning, and also with an attempt at harmlessness.
    That attempt at harmlessness appears even more ham-fisted than usual. The claims of a 0.05% (!?!) false refusal rate are clearly very false. Early public red teaming quickly revealed a number of problems, in a model that cannot be unreleased or fully patched.
    Llama We Doing This Again?
    Meta notices world not yet destroyed and people remain alive, so it has not open sourced enough models. Hence it released Llama 2. Here's the paper, here's the blog announcement, here is a download link to GitHub. Here's Llama-70B on Replicate.
    Simon Willison (re: Replicate): Here's how to use it with LLM:
    llm replicate add \
    replicate/llama70b-v2-chat \
    chat -alias llama70b Then: llm -m llama70b "Invent an absurd ice cream sundae"
    Here's Jim Fan's video guide to fine-tuning using Replicate. Here is Replicate's official guide.
    Here are alternative instructions and a script for training Llama-2 on your own data. Doing this with the 7B model can be done on a T4 GPU, for 70B you'll need an A100.
    Here's an alternative instruction and cookbook from ScaleAI.
    Here's a link to chat with Llama-2 via Perplexity.
    I'll go through the paper. The paper spells out how Llama-2 was trained, spelling out all sorts of parameters. Almost all of them seem standard, but knowing is valuable.
    The System Card
    Llama 2 has double the context length of Llama 1, and was trained on 40% more data.
    They have a chart claiming Llama-2 outperforms MPT and Falcon on various benchmarks.
    They claim that GPT-4 thinks Llama-2 outperforms GPT-3.5.
    The next observation is that Llama-2 is, if you use their own metrics, plays it I would characterize as 'too safe.'
    ChatGPT's rate of violations here is about 7%. Reducing that to 4%, as Llama-2 is claiming, implies an extreme level of caution, or it implies they have greatly surpassed OpenAI's ability to defend against adversarial examples. I know which way I would bet.
    The 7b, 13b and 70b models have been released for commercial use.
    A strange note is that they did not train using data from Meta's services. They had one big advantage, and they did not even use it? This seems to be due to a desire to avoid sources with a lot of private information. If that is the concern, then given the nature of Meta's available data, they have a big problem.
    Their report on training techniques might as well say 'we used standard techniques.' The RLHF is 'we asked people which of two responses was better.' There are some numbers listed and I assume they are completely standard. Biggest change was small amount of 'high quality' fine tuning data.
    How are its capabilities? Here is a comparison. Note which models they chose to compare themselves to here, and which ones they did not. At a given size, this seems like a modest improvement over MPT and Falcon.
    This table covers the real comparisons. Why use different benchmarks, I wonder?
    This tells us that Llama-2 is potentially similar to PaLM-1, with two of its three scores similar to GPT 3.5. Then later they show this:
    We report the results in terms of accuracy in Table 7. As expected, our own reward models perform the best on our internal test sets collected...
    27 min
  • EA - General support for "General EA" by Arthur Malone
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: General support for "General EA", published by Arthur Malone on July 27, 2023 on The Effective Altruism Forum.
    TL;DR: When I say "General EA" I am referring to the cluster including the term "effective altruism," the idea of "big-tent EA," as well as branding and support of those ideas. This post is a response in opposition to many calls for renaming EA or backing away from an umbrella movement. I make some strategic recommendations and take something of a deep dive using my own personal history/cause prioritization as a case study for why "General EA" works (longpost is long, so there's TL;DRs for each major section).
    I'm primarily aiming to see if I'm right that there's a comparatively silent group that supports EA largely as it. If you're in that category and don't need the full rationale and story, the call to action is to add a comment linking your favorite "EA win" (success story/accomplishment you'd like to have people associate with EA).
    Since long before last fall's reckoning, I've been following discussions in the EA community both for or against the "effective altruism" name, debates about rebranding, and calls to splinter the various worldviews currently covered by the EA umbrella into separate groups. There are too many to link, and since this post is ultimately in opposition to them, I prefer not to elevate any specific post.
    I'm actually entirely supportive of such discussions. And I think the reevaluation post-FTX and continued questioning during the EA Strategy fortnight is great, precisely because it is EA in action: trying to use reason to figure out how to do the most good means applying that methodology to our movement, its principles and its public image.
    Unfortunately, I haven't seen a post advocating for a holistic reaffirmation of "EA has already developed and coalesced around a great (if not optimal) movement. We should not only stay the course, but further invest in the EA status quo." Because while status quo bias is a real thing to stay vigilant against, it is also the case that the movement, its name and branding, and the actions it takes in the world, are all the cumulative work of a lot of incredibly intelligent people doing their best to take the right course of action. Don't fix what ain't broke.
    As I interact with EAs as a community builder (I also lead the team organizing EAGxNYC, applications closing soon!) I have heard people advocating for the strategy/branding changes that are described on the forum. However, I perceive this as a minority compared to those who generally think we should just continue "being EA." It is often the case that those in favor of maintaining a positive status quo do not express their position as vocally as those aiming for a change, so I wrote this post to reflect my own view of why it is preferable to stick with general EA.
    I aim to be somewhat ambitious and address several longstanding criticisms about EA, and hope to get some engagement from those with different viewpoints. But I also hope that some of the (what I perceive to be) silent majority will chime in and demonstrate that we're here and don't want to see EA splintered, rebranded, or otherwise demoted in favor of some other label.
    "Effective Altruism"
    TL;DR: There's no word in the English language that accurately covers EA's principles or equally applies to all its community. Every possible name would be a compromise, and "effective altruism" has the benefit of demonstrable success and established momentum. As long as we stick with it as a descriptive moniker rather than asserting it as a prescriptive identifier, it can serve us as well as the names chosen by other movements.
    Circa 2009-2014, I attempted to write a book with the goal of starting a movement of individuals who try to take their ethics seriously and make positive changes in the w...
    20 min
  • LW - Why no Roman Industrial Revolution? by jasoncrawford
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Why no Roman Industrial Revolution?, published by jasoncrawford on July 26, 2023 on LessWrong.
    Why didn't the Roman Empire have an industrial revolution?
    Bret Devereaux has an essay addressing that question, which multiple people have pointed me to at various times. In brief, Devereaux says that Britain industrialized through a very specific path, involving coal mines, steam engines, and textile production. The Roman Empire didn't have those specific preconditions, and it's not clear to him that any other path could have created an Industrial Revolution. So Rome didn't have an IR because they didn't have coal mines that they needed to pump water out of, they didn't have a textile industry that was ready to make use of steam power, etc. (Although he says he can't rule out alternative paths to industrialization, he doesn't seem to give any weight to that possibility.)
    I find this explanation intelligent, informed, and interesting - yet unsatisfying, in the same way and for the same reasons as I find Robert Allen's explanation unsatisfying: I don't believe that industrialization was so contingent on such very specific factors. When you consider the breadth of problems being solved and advances being made in so many different areas, the progress of that era looks less like a lucky break, and more like a general problem-solving ability getting applied to the challenge of human existence. (I tried to get Devereaux's thoughts on this, but I guess he was too busy to give much of an answer.)
    As a thought experiment: Suppose that British geology had been different, and it hadn't had much coal. Would we still be living in a pre-industrial world, 300 years later? What about in 1000 years? This seems implausible to me.
    Or, suppose there is an intelligent alien civilization that has been around for much longer than humans. Would you expect that they have definitely industrialized in some form? Or would it depend on the particular geology of their planet? Are fossil fuels the Great Filter? Again, implausible. I expect that given enough time, any sufficiently intelligent species would reach a high level of technology on the vast majority of habitable planets.
    Devereaux asserts that there is a "deeply contingent nature of historical events . that data (like the charts of global GDP over centuries) can sometimes fail to capture." I see this in reverse: the chart of global GDP over centuries is, to my mind, evidence that progress is not so contingent on random historical flukes, that there is a deeper underlying process driving it.
    So why didn't the Roman Empire have an industrial revolution?
    Consider a related question: why didn't the Roman Empire have an information revolution? Why didn't they invent the computer? Presumably the answer is obvious: they were missing too many preconditions, such as electricity, not to mention math (if you think ENIAC's decimal-based arithmetic was inefficient, imagine a computer trying to use Roman numerals). Even conceiving the computer, let alone inventing one, requires reaching a certain level of technological development first, and the Romans were nowhere near that.
    I think the answer is roughly the same for why no Roman IR, it's just a bit less obvious. Here are a few of the things the ancient Romans didn't have:
    The spinning wheel
    The windmill
    The horse collar
    Cast iron
    Latex rubber
    The movable-type printing press
    The mechanical clock
    The compass
    Arabic numerals
    And a few other key inventions, such as the moldboard plow and the crank-and-connecting-rod, showed up only in the 3rd century or later, well past the peak of the Empire.
    How are you going to industrialize when you don't have cast iron to build machines out of, or basic mechanical linkages to use in them? How could a society increase labor productivity through automation when it hasn't ev...
    6 min