The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • EA - Announcing the Rethink Priorities Special Projects Program by Rachel Norman
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Announcing the Rethink Priorities Special Projects Program, published by Rachel Norman on September 21, 2022 on The Effective Altruism Forum.
    Key points
    Rethink Priorities (RP) has launched a Special Projects (SP) Program to help start promising EA initiatives by providing fiscal sponsorship and full-service operational support–including, but not limited to hiring, finance, event planning, and communications.
    A key strength of RP is its operations. We have been able to scale the organization from 1.5 full-time equivalents (FTE) staff to nearly 50 FTE in just four years.
    The SP Program advances projects that RP would like to see happen and allows these projects to focus on their core work rather than worrying about running their organization.
    Current special projects include Epoch, the Insect Welfare Project, Unjournal, EA Market Testing, Condor Camp, and EA Pathfinder.
    There are various ways to get involved in the SP Program: join our team, apply to have your project sponsored, or share with us lessons you’ve learned incubating projects if you have experience in this arena. Please reach out by submitting an Expression of Interest form.
    About Rethink Priorities
    Founded in 2018, RP is dedicated to informing decisions made by high-impact organizations and funders across various cause areas. To date, our team has conducted over 50 person-years of work (you can find all our public research here). One of our key strengths is our operational capacity, which allows us to recruit, onboard, and support talented researchers to produce quality work with minimal bureaucratic red tape.
    Given our strong operations, RP would like to support other promising EA projects – particularly longtermist ones – in getting off the ground. To this end, we recently launched a new Special Projects Program.
    About the Special Projects Program
    As an off-shoot of our Operations Department, Special Projects is a distinct team dedicated to supporting the launch of new projects rather than running RP’s day-to-day operations.
    The team’s Acting Director Carolyn Footitt is leading this work with Associates María De la Lama and Cristina Schmidt Ibáñez. Their projects generally fall under two areas:
    Incubated (internal)–In addition to our research agenda, RP is incubating direct work and other projects that advance our mission. The SP Team works closely with RP staff to launch these initiatives. Once the incubation period for each respective initiative ends, the project will either conclude or spin-off to become an independent organization.
    Fiscally sponsored (external)–The SP Team is also providing fee-based fiscal sponsorship and support to projects that are managed by individuals outside of RP. Within this model, the project’s founders maintain autonomy and decision-making authority while we provide them with operational and fiduciary oversight.
    Our services
    Although our involvement will depend on the project, in general, the SP Team will provide operational support to projects much in the way that our Core Operations Team supports RP’s work. Such services might include developing and managing budgets, accounting, contracting, running hiring rounds, planning the onboarding of new staff, hosting and developing the project website, and other operations tasks outlined in the below chart.
    Current Special Projects
    The SP Team is currently incubating the following projects:
    LAISR, an AI strategy retreat in Washington, D.C.
    The provisionally-named Insect Welfare Project to address welfare concerns around the growing insect farming industry
    Unjournal, an open platform for research relevant to global priorities
    EA Market Testing, a survey on how to best promote effective giving and action
    EA Pathfinder, an initiative to advise and support mid-career professionals looking to switch into EA work
    Condor Camp, an EA a...
    7 min
  • AF - Nearcast-based "deployment problem" analysis by HoldenKarnofsky
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Nearcast-based "deployment problem" analysis, published by HoldenKarnofsky on September 21, 2022 on The AI Alignment Forum.
    When thinking about how to make the best of the most important century, two “problems” loom large in my mind:
    The AI alignment problem: how to build AI systems that perform as intended, and avoid a world run by misaligned AI.
    The AI deployment problem (briefly discussed here): the question of how and when to (attempt to) build and deploy powerful AI systems, under conditions of uncertainty about how safe they will be and how close others are to deploying powerful AI of their own.
    This piece is part of a series in which I discuss what both problems might look like under a nearcast: trying to answer key strategic questions about transformative AI, under the assumption that key events (e.g., the development of transformative AI) will happen in a world that is otherwise relatively similar to today's.
    A previous piece discussed the alignment problem; this one discusses the deployment problem.
    I’m using the scenario laid out in the previous post, in which a major AI company (“Magma,” following Ajeya’s terminology) has good reason to think that it can develop transformative AI very soon (within a year), using what Ajeya calls “human feedback on diverse tasks” (HFDT) - and has some time (more than 6 months, but less than 2 years1) to set up special measures to reduce the risks of misaligned AI before there’s much chance of someone else deploying transformative AI. I discuss what Magma would ideally do in this situation.
    I’m also introducing another hypothetical actor in this scenario, “IAIA2”: an organization, which could range from a private nonprofit to a treaty-backed international agency, that tracks3 transformative AI projects and takes actions to censure or shut down dangerous ones, as well as doing other things where a central, neutral body (as opposed to an AI company) can be especially useful. (More on IAIA below.)
    I’m going to discuss what Magma’s and IAIA’s major goals and priorities should be in the “nearcast” situation I’m contemplating; a future piece will go through what a few stylized success stories might look like. I’ll be bracketing discussion of the details of how Magma can reduce the risk that its own AI systems are misaligned (since I discussed that previously), and focusing instead on what Magma and IAIA should be looking to do before and after they achieve some level of confidence in Magma’s systems’ alignment.
    I focus on Magma and IAIA for concreteness and simplicity (not because I expect there to be only two important actors, but because my takes on what most actors should be doing can be mostly inferred from how I discuss these two). I sometimes give more detail on Magma, because IAIA is a bit more speculative and unlike actors that exist today.
    My discussion will be very high-level and abstract. It leaves a lot of room for variation in the details, and it doesn’t pin down how Magma and IAIA should prioritize between possible key activities - this is too sensitive to details of the situation. Nonetheless, I think this is more specific than previous discussions of the deployment problem, and for one who accepts this broad picture, it implies a number of things about what we should be doing today. I’ll discuss these briefly in the final section, and more in a future post.
    Summary of the post (bearing in mind that within the nearcast, I’m using present tense and not heavily flagging uncertainty):
    I’ll first give a bit more information on the hypothetical setting of this nearcast (specifically, on the addition of IAIA to the scenario discussed previously).
    I’ll break this scenario up into three stylized “phases,” even though in practice I think the boundaries between them could be fuzzy.
    “Phase 1” refers to the period of time when...
    42 min
  • EA - Announcing “Effective Dropouts” by Yonatan Cale
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Announcing “Effective Dropouts”, published by Yonatan Cale on September 21, 2022 on The Effective Altruism Forum.
    TL;DR: “Effective Dropouts” is meant to be a casual fun excuse for reminding people that dropping out of a degree can be a good decision, as a counter to all the existing pressure for degrees being the default/only/obvious way. The rest of the post is mostly a joke.
    Our values
    We strive to have the values of Effective Altruism plus the inverse of the values of universities.
    Who can join
    Anyone who drops out of a degree.
    But, having the inverse of university values, we are not strict about our criteria. For example, one of our founders, Yonatan, didn’t drop out of a degree, but he can join anyway. He’s also writing these lines right now by the way.
    What can joining provide?
    You can, if you want, join as a co-author of this post and change it however you want. Universities would tell you what to do. We would just open a new “organization” if we don’t like what you did with ours.
    Ah, and also moral support, and if things go really well, we might have stickers.
    Do we know anything about university?
    Yeah, one of the co-founders, Vorathep, is Head of Coaching at Effective Thesis and used to have his own coaching company targeted at university students. Vorathep is a PhD student right now, but thinks dropping out can happen at any level, so don't lose hope!
    What about the other cofounder(s)?
    Yonatan visited his friend in university for one day to see what all the fuss is about, after which he convinced his friend to quit. This was a pretty productive day overall, and Yonatan wonders if this means he should actually start going regularly.
    Gavin is a weird choice for a co-founder because he has 4 degrees, but this too is aligned with our values.
    Do we think everyone should drop out?
    No.
    We’ll be politically correct and say “only some people”.
    Saying “here is the path everyone should go” is against our values. We encourage people to consider their own specific situation, and maybe tell us more about it.
    Are we giving a balanced view of both sides?
    No, but unlike universities, we are not pretending to give a balanced view, so we think it’s more fair.
    What do we recommend doing instead of university?
    Well, if you’re going to university in order to get accepted to some company, X, then as a naive suggestion, try getting accepted to X right now. Maybe it will just work? Unless you plan, for example, on working in a nuclear power plant, in which case please get the appropriate training first, whatever they say it is, university or otherwise. Or actually, apply and if you don’t get accepted, ask for feedback on what to learn, why not?
    Homer getting some on-the-job training. Might not be ideal for this specific line of work.
    What about all the useful courses there are in university?
    Looking at the useful courses is what we call “glass half full thinking”. We try encouraging “glass half empty thinking”. What about all the un-useful courses?
    Or more to the point, can you do the useful courses online?
    But university will help open more doors, no?
    Yeah, it will help in a non-zero amount, but we think this is the wrong question.
    We like asking “will it help more than the alternative”.
    Did you consider any alternative?
    As a naive example, “doing a Udemy course will get me a job in X time, and doing a degree will get me a job in Y time”.
    We call this “thinking outside the box”, where in this case the box is university.
    We also think about this from the Effective Altruism values. We prefer not asking “will this donation help anything”.
    we prefer asking “will it help more than the alternative”.
    Yep, I just made that into a title because I wanted to.
    But university teaches the basics, no?
    University teaches things that they brand as “the basics”. It’s a marketing trick that went to...
    5 min
  • EA - CEA's Events Team is Hiring! by Amy Labenz
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: CEA's Events Team is Hiring!, published by Amy Labenz on September 21, 2022 on The Effective Altruism Forum.
    I’m thrilled to announce that the CEA Events Team is hiring for three positions on our team: EA Global Events Associate, Retreats Associate, and Community Events Associate.
    If you’re passionate about effective altruism, would love organizing events, and want to join an energetic team, apply by October 11th 2022, 1:00 am BST!
    Why join the Events team?
    The Events team creates high-quality discussion spaces that connect, inform, and inspire people in ways that help them have a greater positive impact on the world. We run three programs:
    EA Global — organizing large conferences for those significantly involved in EA.
    Retreats — organizing retreats for community leaders and other select groups.
    Community Events — funding and supporting events run by community members, such as EAGx conferences.
    We’re proud of what we’ve achieved so far in 2022. We’re on track to facilitate more connections this year than every other year combined — and four times as many this year as in 2021.
    Some other highlights include:
    Organizing 3 EA Global conferences in London, San Francisco, and Washington DC, with more than 4,000 attendees in total and receiving consistently high “likelihood to recommend” scores, all ~9/10.
    Running 4 retreats for community leaders, field experts, and other groups, with more than 150 participants and glowing feedback, and stakeholders consistently reporting 10/10 logistics.
    Supporting 10 EAGx and other community events in 7 different countries, with more than 3,000 attendees and high satisfaction and impact scores (see our July update on the Community Events program for more).
    But we’re not stopping here. We have ambitious plans for our events to be bigger and better in 2023 and beyond, and we need your help to make that happen. Already we’ve gone from 1.5 full-time equivalents to 7, with three different program areas. We’re hiring one role for each of these areas, to help us scale while keeping quality high.
    Who are we looking for?
    We’re looking for people who share our values of earnest ambition, independent motivation, and interest in altruistic impact. You should also have:
    A strong alignment with and understanding of effective altruism and its principles.
    A keen eye for detail, quality, and efficiency, and the ability to juggle multiple tasks and deadlines.
    A collaborative and supportive mindset, and the ability to communicate clearly and respectfully with a diverse range of stakeholders.
    A growth-oriented and flexible attitude, and the willingness to learn from feedback and adapt to changing circumstances.
    What are the roles?
    The three roles we’re hiring for are:
    How to apply?
    If you’re interested in applying for one or more of these roles, please fill out this application form by Tuesday, October 11th 2022, 1:00 am BST. You’re welcome to apply to one, two, or all three roles via the same form.
    We’re committed to creating a diverse and inclusive team, and we welcome applications from people of all backgrounds, identities, and experiences. We’re happy to accommodate any reasonable adjustments you may need during the application process.
    If you have any questions about the roles or the application process, please feel free to email me at [email protected]. I’d love to hear from you!
    I hope you’re as excited as I am about the opportunity to join the Events team at CEA and help us create amazing events for the EA community. I look forward to receiving your application and getting to know you better. Good luck!
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • EA - Establishing Oxford’s AI Safety Student Group: Lessons Learnt and Our Model by CharlieGriffin
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Establishing Oxford’s AI Safety Student Group: Lessons Learnt and Our Model, published by CharlieGriffin on September 21, 2022 on The Effective Altruism Forum.
    In January we founded a student group at Oxford focused on technical AI safety. Since then we’ve run speaker events, socials, multiple cohorts of the AGISF, and supervised research projects (“Labs”). We think it went pretty well, so we’re sharing our takeaways and model here.
    This post is a short summary of this public document which goes into more detail about our approach to AI safety community building, reflections, and recommendations.
    Non-trivial takeaways
    Launching as part of an AI group, rather than an EA group, worked well for us. (see more)
    Outreach aimed at people interested in AI reached a much larger technical audience than past outreach aimed at people interested in EA or longtermism. (see more)
    It was surprisingly easy to interest people in AI safety without appealing to EA or longtermism. (see more)
    Significant value from our speaker events seemed to come from the high-retention, friendly socials we held afterwards. (see more)
    Our “Labs” model of student research projects seems effective for development and output with minimal time-cost for an expert supervisor (~1 hour per week). This is particularly valuable if field building is mentorship bottlenecked (see more).
    Our current model
    Our working objective was to increase the number and quality of technical people pursuing a career in AI safety research. To do this, we have been operating with the following pipeline:
    Results so far
    At least 2 of the current participants of Redwood’s MLAB this summer had never encountered AI safety or EA before attending our events this spring.
    We had 24-73 people attend our 9 speaker events, with 69% (on average) having a STEM background (according to survey data).
    65 people signed up for our AGI Safety Fundamentals course across 11 cohorts. 57% had STEM backgrounds.
    Further Information
    Please see the attached public document for further information about the student group or our contact details.
    We are now reconsidering our working objective and don’t necessarily endorse the stated objective "to increase the number and quality of technical people pursuing a career in AI safety research". However, we think it is important to start from your objective and work backwards, and this is the objective we actually used.
    We want to note that having a target audience of people “interested in AI” creates a self-selection effect that reduces the diversity of thought in our attendance. We are working to improve this.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    3 min
  • LW - The Redaction Machine by Ben
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: The Redaction Machine, published by Ben on September 20, 2022 on LessWrong.
    On the 3rd of October 2351 a machine flared to life. Huge energies coursed into it via cables, only to leave moments later as heat dumped unwanted into its radiators. With an enormous puff the machine unleashed sixty years of human metabolic entropy into superheated steam.
    In the heart of the machine was Jane, a person of the early 21st century.
    From her perspective there was no transition. One moment she had been in the year 2021, sat beneath a tree in a park. Reading a detective novel.
    Then the book was gone, and the tree. Also the park. Even the year.
    She found herself laid in a bathtub, immersed in sickly fatty fluids. She was naked and cold.
    The first question Jane had for the operators and technicians who greeted her with a warm towel was "where am I?''. They brought back the dead a hundred times a day, and knew that it was best to answer when, not where.
    Jane's second question was "how did I come to be in the year 2351?''.
    The answer begins in the year 2021. Jane sat beneath a tree. She read her book. She walked home. She attended university. She played her guitar. Went to pubs and festivals with her friends. She studied philosophy as her course, but there wasn't much work going in analysing Plato so she got a job in marketing.
    She married, had children. Lived a normal enough life.
    She followed the scientific news no more than most. She did watch the much-hyped documentary about the possibility of restoring objects to a previous state. She found it a disappointment. So they could get a single molecule to unreact? Maybe some chemist somewhere cared.
    But technology's march was unceasing. The egg was unboiled only two decades later.
    The redaction machines, as they came to be known, restored an object to a previous state. Set the machine for 10 minutes and insert your alarm clock. Ping! The machine takes no time at all to operate. Within find alarm clock, time as it read 10 minutes ago.
    Smash said alarm clock with hammer. Insert the pieces into the machine. Activate. Find alarm clock restored, exactly, to state 10 minutes prior. No longer smashed. It is not now a repaired alarm clock. If something has been repaired then one supposes that it was once broken. A repaired thing still possesses the history of being broken and then fixed. But that clock, as taken from the machine, is the clock from earlier, before it ever suffered damage. Its history taken from it. The breakage unhappened.
    The first resurrection was only a half-decade after the egg. By the same token as the clock this was not truly a resurrection. It was a restoration, an undoing of time's passage on a single person. "Resurrection'', despite its flaws as a term, became the standard manner of speaking about these things.
    Accidental death dropped to almost zero in the developed world. Or at least, unredacted, accidental death did. Truly the number of deaths increased modestly, as some people became more brazen. But nearly all were redacted.
    Ambulances would carry the corpses made by a traffic accident to a redaction clinic. Death 1 hour ago. Re-set patient. It would be a shock to transition from driving to a strange hospital, with no memory of the accident (the neurochemistry encoding any such memory was just as unhappened as the tearing of ligaments and the crush of bones). But it was surely better than being dead.
    During redaction every subatomic particle in an object would run its past trajectory backwards as best it could. The theory of relativity demanded that centre-of-mass motion of the object as a whole be an exception to this rule. Reality complied.
    For humans, respiration acted in reverse. Blood cells passed backwards through arteries, carrying newly minted oxygen from the muscles out to the lungs to exhale. Electrical i...
    45 min
  • EA - Criticism of the 80k job board listing strategy by Yonatan Cale
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Criticism of the 80k job board listing strategy, published by Yonatan Cale on September 21, 2022 on The Effective Altruism Forum.
    TL;DR: Here’s a poll for the EA Twitter community:
    I’ll describe the poll in words, mainly for listeners of the Nonlinear Podcast:
    The poll says “The 80k job board isn’t “a list of impactful jobs”, it also has other jobs meant to build career capital, and there’s no way to tell which is which. 1: Did you know this? 2: Is it important?
    55% of the poll respondents didn’t know this is the situation, and they think it’s important. The other answers got about 15% of the votes each. There were 140 votes in total.
    Why I think this is important
    Many professionals in EA want to move to the stage in their career where they have a lot of impact, and they want to pick a job for that, and want something like a job board with high impact jobs.
    I always thought 80k’s job board was that.
    I recently learned that 80k don’t even try to be “a list of high impact jobs”, they also list some roles for mainly career capital reasons, plus some other problems listed below.
    Sad emoji
    Read more
    Caleb, head of EA Funds, posted a shortform titled “The 80k job board has too much variance”.
    In the comments, we discuss problems like the 80k posting jobs that might be actively harmful, and there being no [reasonable in my opinion] way to push back on that.
    Solutions
    TL;DR:
    Have a job board that aims to only include high impact jobs.
    Let people comment and discuss whether jobs are high impact.
    Better communicating the current situation seems positive (and is a big reason I think posting this is good), but I don’t personally think it’s enough.
    I’m not elaborating in order to keep this post short, but we can discuss in the comments, or maybe someone has a better idea.
    80k’s response
    In the job board page:
    They have a big title that says “Some of these roles directly address some of the world’s most pressing problems, while others may help you build the career capital you need to have a big impact later.”:
    80k’s website, on promoting some roles at potentially harmful organizations
    80k have a FAQ called “You're promoting a role at an organisation that I think is causing harm. Why is this?”, where the answer is (in my words), that this might be useful for building career capital or for helping improve the org from the inside:
    Criticism: “Improving the org from the inside”:
    A lot of 80k’s audience are not highly involved in the EA community, these are simply people who reached 80k through 80k’s amazing SEO and marketing. These people are not who I’d pick to “improve the org from the inside”
    This isn’t mentioned in the org’s job description! I might take a job that 80k thinks could have a high impact if I improved the org from the inside - but I won’t know about this - and I’d just help the org with its current agenda
    I think it’s questionable whether “improving the org from the inside” (if the org is doing harm) is positive or negative expected value, and I’m tempted to elaborate on how I’d analyze this question, but my short version is “this is complicated and needs to be discussed” especially for someone going to take such a job.
    Regarding taking a harmful job in order to build career capital:
    80k’s article on taking a harmful job
    Their post was updated recently, not years ago.
    I would say that it might sometimes be ok to take a harmful job in order to do more good, but it is not ok to send other people to a harmful job without them knowing about it (plus, hopefully, thinking about the pros and cons of their situation for a few minutes).
    Criticism on closed door push backs:
    80k suggests that the way to push back on a job is to send them a private message:
    I think this is problematic - they might forget about such a message, or miss it because of too much work, and so on. I thin...
    5 min
  • EA - Quantified Intuitions: An epistemics training website including a new EA-themed calibration app by Sage
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Quantified Intuitions: An epistemics training website including a new EA-themed calibration app, published by Sage on September 20, 2022 on The Effective Altruism Forum.
    Crossposted to LessWrong
    TL;DR Quantified Intuitions helps users practice assigning credences to outcomes with a quick feedback loop. Please leave feedback in the comments, join our Discord, or send thoughts to [email protected].
    Quantified Intuitions
    Quantified Intuitions currently consists of two apps:
    Calibration game: Assigning confidence intervals to EA-related trivia questions.
    Question sources vary but many are from Anki deck for "Some key numbers that (almost) every EA should know"
    Compared to Open Philanthropy’s calibration app, it currently contains less diversity of questions (hopefully more interesting to EAF/LW readers) but the app is more modern and nicer to use in some ways
    Pastcasting: Forecasting on already resolved questions that you don’t have prior knowledge about.
    Questions are pulled from Metaculus and Good Judgment Open
    More info on motivation and how it works are in the LessWrong announcement post
    Please leave feedback in the comments, join our Discord, or send it to [email protected].
    Motivation
    There are huge benefits to using numbers when discussing disagreements: see “3.3.1 Expressing degrees of confidence” in Reasoning Transparency by OpenPhil. But anecdotally, many EAs still feel uncomfortable quantifying their intuitions and continue to prefer using words like “likely” and “plausible” which could be interpreted in many ways.
    This issue is likely to get worse as the EA movement attempts to grow quickly, with many new members joining who are coming in with various backgrounds and perspectives on the value of subjective credences. We hope that Quantified Intuitions can help both new and longtime EAs be more comfortable turning their intuitions into numbers.
    More background on motivation can be found in Eli’s forum comments here and here.
    Who built this?
    Sage is an organization founded earlier this year by Eli Lifland, Aaron Ho and Misha Yagudin (in a part-time advising capacity). We’re funded by the FTX Future Fund.
    As stated in the grant summary, our initial plan was to “create a pilot version of a forecasting platform, and a paid forecasting team, to make predictions about questions relevant to high-impact research”. While we build a decent beta forecasting platform (that we plan to open source at some point), the pilot for forecasting on questions relevant to high-impact research didn’t go that well due to (a) difficulties in creating resolvable questions relevant to cruxes in AI governance and (b) time constraints of talented forecasters. Nonetheless, we are still growing Samotsvety’s capacity and taking occasional high-impact forecasting gigs.
    Eli was also struggling some personally around this time and updating toward AI alignment being super important but crowd forecasting not being that promising for attacking it. He stepped down and is now advising Sage part-time.
    Meanwhile, we pivoted to building the apps contained in Quantified Intuitions to improve and maintain epistemics in EA. Aaron wrote most of the software for both apps within the past few months, Alejandro Ortega helped with the calibration game questions and Alina Timoshkina helped with a wide variety of tasks.
    If you’d like to contact Sage you can message us on EAF/LW or email [email protected]. If you’re interested in helping build apps similar to the ones on Quantified Intuitions or improving the current apps, fill out this expression of interest. It’s possible that we’ll hire a software engineer, product manager, and/or generalist, but we don’t have concrete plans.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • EA - What Do AI Safety Pitches Not Get About Your Field? by Aris Richardson
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: What Do AI Safety Pitches Not Get About Your Field?, published by Aris Richardson on September 20, 2022 on The Effective Altruism Forum.
    When I was first introduced to AI Safety, coming from a background studying psychology, I kept getting frustrated about the way people defined the and used the word "intelligence". They weren't able to address my questions about cultural intelligence, social evolution, and general intelligence in a way I found rigorous enough to be convincing. I felt like professionals couldn't answer what I considered to be basic and relevant questions about a general intelligence, which meant that I took a lot longer to take AI Safety seriously than I otherwise would have. It feels possible to me that other people have run into AI Safety pitches and been turned off because of something similar -- a communication issue because both parties approached the conversation with very different background information.
    I'd love to try to minimize these occurrences, so if you've had anything similar happen, could you please share: What is something that you feel AI Safety pitches usually don't seem to understand about your field/background? What's a common place where you feel you've become stuck in a conversation with AI Safety pitches? What question/information makes/made the conversation stop progressing and start circling?
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Twitter Polls: Evidence is Evidence by Zvi
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Twitter Polls: Evidence is Evidence, published by Zvi on September 20, 2022 on LessWrong.
    Follow-up to: Law of No Evidence
    Recently, there was some debate about a few Twitter polls, which led into a dispute over the usefulness of Twitter polls in general and how to deal with biased and potentially misleading evidence.
    Agnus Callard is explicitly asking the same question I asked, which is the opposite of ignoring sample bias: What is accounting for the difference?
    Sample selection is definitely one of the explanations here. One can also point to several other key differences.
    My poll asks about you, Patrick asks about how others seem.
    My poll asks about struggle, Patrick asks about stability.
    My poll asks about a year versus a point in time, a potential flaw.
    My poll asks about now, Patrick asks about since pandemic onset.
    None of this is well-controlled or ‘scientific’ in the Science sense. No one is saying any of this is conclusive or precise.
    What is ‘bad’ evidence if it isn’t weak evidence? Adam’s theory here is that it is misleading evidence. That makes sense as a potential distinction. Under this model:
    Weak evidence induces a small Bayesian update in the correct direction.
    Bad evidence can induce an update in the wrong direction.
    Usually, people with such taxonomies will also think that strong evidence by default trumps weak evidence, allowing you to entirely ignore it. That is not how that works. Either something has a likelihood ratio, or it doesn’t.
    The question is, what to do about the danger that someone might misinterpret the data and update ‘wrong’?
    I love that the account is called ‘Deconstruction Guide.’ Thanks, kind sir.
    Whether or not this ‘depends on the poll’ depends on what level of technically correct we are on, and one can go back and forth on that several times. The fully correct answer is: Yes, some info. You always know that the person chose to make the poll, and how many people chose to respond given the level of exposure, and the responses always tell you something, even if the choices were ‘Grune’ and ‘Mlue,’ ‘Yes’ and ‘Absolutely,’ or ‘Maybe’ and ‘Maybe Not.’
    Remember that if any other result would have told you something, then this result also tells you something, because it means the result that would have told you something did not happen. That doesn’t mean it helps you with any particular question.
    Anyway, back to main thread.
    Getting into a Socratic dialog with a Socratic philosopher, and letting them play the role of Socrates. Classic blunder.
    I certainly want to know the extent to which the world is full of lunatics.
    Adam Gurri’s new claim has now narrowed to something more reasonable, that citing a Twitter poll as representative even of some subgroup marks you as foolish.
    We can agree that taking a Twitter poll, not adjusting for sample bias, and drawing conclusions is foolish. Saying it equates to a subgroup that is similar to the group polled still requires dealing with response bias and all that, but mostly seems fine. Adjusting for the nature of your sample should render the whole thing fine in any case.
    You can also find good information in a Twitter poll by comparing its results to another Twitter poll using the same account (and same retweets, ideally). The difference between the two is meaningful. This can be a difference between questions or wordings, or a difference over time, or something else.
    Rules of Evidence
    Aristotle is indeed wise. He points to the important distinction between evidence, as in Bayesian evidence or a reason one might change one’s mind or one’s probabilities, and the rules of evidence in a given format of debate or discourse. In a court of law, some forms of Bayesian evidence are considered irrelevant or, even more extremely, prejudicial, exactly because they should cause one to update their probabi...
    12 min