The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • EA - The Future Perfect 50 by Catherine Low
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: The Future Perfect 50, published by Catherine Low on October 23, 2022 on The Effective Altruism Forum.
    I just saw that Future Perfect have a new feature. I found it really inspiring so I thought I'd share it here. It is the Future Perfect 50: The scientists, thinkers, scholars, writers, and activists building a more perfect future.There are some wonderful profiles of people that will be familiar to many Forum readers, like Leah Garcés' work with farmers, Lucia Coulter and Jack Rafferty's work on Lead Elimination and Kevin Esvelt's Gene Drive research.
    But there are a host of inspiring people and stories I've never heard before, like Setusko Thurlow's anti-nuclear weapon work, Joy Buolamwini's algorithmic justice campaign, and Olga Kikou's fight for a ban on all caged farming in the EU.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Mnestics by Jarred Filmer
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Mnestics, published by Jarred Filmer on October 23, 2022 on LessWrong.
    Take your mnestic
    Part IV
    In the web series "There is No Antimemetics Division" our heroes must fight a great evil, monsters that make you forget they exist. In the course of such adventures, they find it necessary to imbibe "mnestics" (the opposite of an amnesiac), drugs for remembering.
    Every morning since I left that cabin, I wake up having to remember only one thing.
    Take. your. mnestic
    To do this, I sit with my laptop and place a leaf between my lips. This looks odd if I happen to be in a cafe, but serves to remind me I was doing something important if I get distracted. It also helps to turn interruptions like "do you have a second?", into "Jarred, why are you eating a leaf?".
    I hit "ctrl+m" to pull up my desktop forever dedicated to "mnestic.txt" and my calendar. The contents of mnestic.txt have changed over time, but the quote at the top is always the same:
    Humans can forget anything. It's okay to forget some things, because we are mortal and finite. But some things we have to remember. It's important that we remember. Write to yourself something which will make you remember.
    There Is No Antimemetics Division
    I read it one word at a time, and try to recapture that sense of dread. The feeling of recalling something existentially important that needs sustained action over years. Knowing I'll forget.
    I read the second line, still a word at a time:
    A routine of self perpetuating, undistracted time to think is necessary to respond well to being alive.
    I try to recall the feeling I had sitting in that cabin, that "Space" is something both vital and fragile, and while I have it, I need to use it to ensure I don't lose it. It's at this stage I check my calendar to confirm the week's mnestics are all lined up, coming to me free and clear down the river of time.
    I read the remaining 8 lines from past selves who had access to a wealth of space, reminding me of how I want live. With my priorities freshly re-downloaded into my brain, I plan my day, set intentions, and make a todo list. Altogether this takes around 30 minutes.
    To finish, I try to capture in time who I feel I am now, and verbally extend a bridge to my future self. Tomorrow when sitting down to take his own mnestic, he will think of this moment and verbally accept that bridge from the past, creating a chain throughout time built of 30-minute pockets of daily space-taking. A highway down which compressed 4-day thoughts can stream from the past to find me here in the present.
    Every Sunday morning I take a larger dose, clearing a space in which to spend 2 hours trying to make sense of the last 168. I get a narrative sense of the week past, how it compares to the story I wanted to tell, and where that narrative wants to go over the next 7 days. I outline projects, make todos, and most important of all, visualise the structure of the days within which I'll work.
    It feels like gathering a Kamehameha of intention, shot wide and strong into the week to bring the shards of my agency scattered through time into alignment. This might mean 2 or 3 decisions made differently than I might have done otherwise, or it might mean 50.
    Leaving a party an hour early to get to sleep on time, saying no to meeting a school friend, saying no to another conference, remembering to take decaf in the afternoon, reading that article, organising that book club, promptly responding to important messages.
    These are things I can only do reliably when I'm in regular emotional contact with a picture of what actually moves me, ordinarily too big to fit through the door of my mind at short notice. But if one takes a massive shot of space with which to dwell on it, you can compress that picture down into a mnestic you can take daily.
    "Renew thyself completely each day; do it aga...
    6 min
  • EA - Progress Open Thread: EAGxVirtual 2022 by Alex Berezhnoi
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Progress Open Thread: EAGxVirtual 2022, published by Alex Berezhnoi on October 22, 2022 on The Effective Altruism Forum.
    Almost 900 people joined the EAGxVirtual conference this weekend from all over the world. And for many of them, it's their first EA conference. We are encouraging attendees to post here if they learn something useful, change their plans, have a really good meeting, etc. It can inspire others and help you reflect on personal experiences. See this post for ideas.
    These updates can be very short. But you might also want to talk about people, organizations, or resources that were useful to you. Someone might have been counterfactually responsible for some of your progress and not even know it!
    Looking forward to hearing your stories from the conference!
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Wisdom Cannot Be Unzipped by Sable
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Wisdom Cannot Be Unzipped, published by Sable on October 22, 2022 on LessWrong.
    Introduction
    The year was 2016 (or close enough), and a friend of mine’s younger brother - we’ll call this younger brother Luke - was about to start college.
    Having completed college not that long ago, I thought it would be nice if I could make a list of some of the things that had helped me - the strategies and disciplines that I had made use of - to hand to this prospective scholar.
    I made my list, including links to productivity resources and guides to How To Get Things Done, and prepared to hand it off to Luke with my best wishes.
    I remember how it felt, handing him that list. I was envious of Luke, in a way; I wish that I had had someone hand me this list back when I started college. It would have made things so much easier! And here I was, just handing Luke the keys to success on a silver platter.
    He didn’t even know how lucky he was. I could picture how much easier he’d find things than I did, with the steps on his path helpfully guided by my concise and helpful list.
    A few months later, I check in with my friend as to how his younger brother is doing, sure that I am about to hear a tale of effortless success and, well.
    Luke was failing his classes.
    I later learned that Luke had dropped out after his first year.
    Nowadays Luke’s doing his own thing, and I have, shall we say, different opinions about the utility of college in general. And I can look back at the list I gave him and admit that it was not a perfect distillation of how to Mange Time Effectively and Really Get Things Done.
    At the time though, I was aghast, and spent a great deal of thought on how my Super Awesome List failed to teach Luke the secrets I had learned throughout college on How To Get Things Done.
    What I realized, after a great deal of introspection, was that it was inherent to the nature of wisdom itself that it cannot be decompressed. What follows is an examination of that idea.
    Part I: Gird Your Metaphors
    Compression as a Technology
    Compression is a key technology in digital systems. It’s what happens when you ‘zip’ a file - the file size is reduced, like packing a puffy winter jacket in a suitcase by sitting on the suitcase until you can get it closed.
    We compress data in digital systems because data transmission and storage aren’t free, in money or in time. It takes longer to send a gigabyte than a megabyte, and you can (by definition) store a thousand of the latter for every one of the former.
    It becomes valuable, then, to compress any data we send before we send it; it can then be decompressed (unzipped) upon being received.
    With me so far?
    Wisdom as Large Pieces of Data
    People have been defining wisdom since there have been bearded old men claiming to have it. For our purposes, we’ll be defining ‘wisdom’ as a large piece of data, generally in the form of a life lesson synthesized into a series of recommended behaviors for various situations created from accumulated life experience.
    (Don’t worry, we’ll get to concrete examples in a second.)
    Talking as Transferring Data
    Just as data is transferred from one computer to another along wires, ‘knowledge’ - or ‘wisdom’ - is transferred from one person to another via sound waves, or, you know, talking.
    The problem here is that computers can transfer massive amounts of information between each other very very quickly. Humans cannot; no matter how fast we talk, talking remains a very slow method of communication. (Consider the information transfer of an eBook: the book could be transmitted from a source computer to your computer/kindle/device in seconds, but if you tried to read the book to another person, it would take hours.)
    To solve this problem, we humans compress the data we transfer via talking. We don’t describe the book we’re reading by reciting the ent...
    12 min
  • LW - Deepfake(?) Phishing by jefftk
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Deepfake(?) Phishing, published by jefftk on October 21, 2022 on LessWrong.
    I think someone just tried to phish my Facebook account, including a fake video of a FB friend. Here's the conversation:
    Them, via FB Messenger, 9:32am:
    Please ,I was trying to login in my instagram page on Facebook my new phone and they ask me to find someone to help me receive a code, Facebook gave me two friends suggestions and you one of them, the other person isn't online. will you Help me receive the code please?
    Me:
    I'm sorry you're having trouble logging in! Just so I can make sure your account hasn't been hacked, how did we meet?
    Them:
    [Calls me over FB Messenger, audio isn't working but it does look like them. I'm completely convinced at this point.]
    Me:
    Audio wasn't working, but I did recognize youWhat do you need me to do?
    32665, over SMS:
    NNNNNNNN is your Facebook password reset code [this number has previously sent me FB resets]
    Them:
    Send me the code sent to you minute ago
    Me:
    Hmm, those look like the code to reset the password to my account?Can we call again?
    Me:
    [I try to call them back, doesn't go through]
    Them:
    Nahh it's for my instagram
    Them:
    Having bad connections here
    Them:
    Send me the code ?
    Me:
    sorry, I'm still worried your account has been hacked -- can we do another call?
    Them:
    [Calls me over FB Messenger, audio is still not working, and the video feels slightly off. Ends quickly on their end. Possibly it's even the same video from last time?]
    Me:
    We're you able to hear me?
    Them:
    My connections
    I've reported their account as hacked.
    Things that made me suspicious:
    I don't think FB has any sort of account recovery that looks like this
    This is exactly what an attempt to hack my FB account would look like
    9:30am, even though that makes it 6:30 where they live
    Video call didn't have any audio
    They couldn't receive incoming video calls
    Text did't feel like them, though I don't know them that well.
    Here's a screenshot I took during the second video call:
    Even with all those things, the video call would normally have been very convincing, and it did briefly convince me. I could easily see it fooling someone who didn't know about deepfake video.
    Comment via: facebook
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    3 min
  • EA - Open position at 80,000 Hours: Recruiter by 80000 Hours
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Open position at 80,000 Hours: Recruiter, published by 80000 Hours on October 20, 2022 on The Effective Altruism Forum.
    Summary
    We’re hiring a recruiter to help us grow the 80,000 Hours team.
    Not being able to hire fast enough is one of our biggest bottlenecks as an organisation. The person in this role will directly address this by helping to identify potential candidates, run hiring rounds, and scale our recruitment processes as we grow. They’ll be key to increasing 80,000 Hours’ impact over the coming years.
    You might be a great fit if you:
    Have a strong understanding of effective altruism / longtermism.
    Have excellent organisational / project management skills.
    Are a clear communicator, both in writing and in person.
    Would enjoy interacting with and evaluating people.
    This is a full-time role. Ideally, you’d be based at our London office, but we’re open to remote candidates (as long as you’re able to work within UK working hours).
    We’re willing to consider candidates who are available to start anytime between December 2022 and August 2023 — so please consider applying even if you’re not available immediately.
    The starting salary for someone with one year of highly relevant experience is £59,200 per year.
    The role
    You’ll be managed by Sashika Coxhead, our Head of Recruiting, and will have the opportunity to work closely with hiring managers from other teams.
    Initial responsibilities will include:
    Project management of active recruiting rounds. For example, overseeing the candidate pipeline and logistics of hiring rounds, making decisions on initial applications, and managing candidate communications.
    Sourcing potential candidates. This might include generating leads for specific roles, publicising new positions, reaching out to potential candidates, and answering any questions they have about working at 80,000 Hours.
    Taking on special projects to improve our recruiting systems. For example, you might help to build an excellent applicant tracking system, test ways to improve our ability to generate leads, or introduce strategies to make our hiring rounds more efficient.
    Depending on your skills and interests, you might also:
    Take ownership of a particular area of our recruiting process, e.g. proactive outreach to potential candidates, our applicant tracking system, or metrics for the recruiting team’s success.
    Conduct screening interviews where needed, to assess applicants’ fit for particular roles at 80,000 Hours.
    After some time in the role, we’d hope for you to sit on internal hiring committees. This involves forming an inside view on candidates’ performance; discussing uncertainties with the hiring manager and committee; and, with the other committee members, giving final approval on who to make offers to.
    Who we’re looking for
    You might be a great fit if you:
    Have a strong interest in and understanding of effective altruism and longtermism. Ideally, you have evidence of previous involvement with EA (e.g. being a member or organiser of a local or university group, attending a previous EAG or EAGx conference, volunteering or working with an EA organisation) and have a deep understanding of key EA concepts.
    Are highly conscientious and organised. You take pride in your attention to detail, can keep track of multiple moving parts within a project, and don’t let things fall through the cracks. Ideally, you have previous experience successfully managing projects (e.g. running events or doing local/university group organising).
    Are a clear communicator, both in writing and in person. You’re able to discuss uncertainties with hiring managers efficiently and can communicate clearly but sensitively with candidates.
    Are interested in thinking about people. You have strong interpersonal skills, love trying to develop accurate models of others, and would enjoy thinking abo...
    6 min
  • EA - The heritability of human values: A behavior genetic critique of Shard Theory by Geoffrey Miller
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: The heritability of human values: A behavior genetic critique of Shard Theory, published by Geoffrey Miller on October 20, 2022 on The Effective Altruism Forum.
    Overview (TL;DR):
    Shard Theory is a new approach to understanding the formation of human values, which aims to help solve the problem of how to align advanced AI systems with human values (the ‘AI alignment problem’). Shard Theory has provoked a lot of interest and discussion on LessWrong, AI Alignment Forum, and EA Forum in recent months. However, Shard Theory incorporates a relatively Blank Slate view about the origins of human values that is empirically inconsistent with many studies in behavior genetics indicating that many human values show heritable genetic variation across individuals. I’ll focus in this essay on the empirical claims of Shard Theory, the behavior genetic evidence that challenges those claims, and the implications for developing more accurate models of human values for AI alignment.
    Introduction: Shard Theory as an falsifiable theory of human values
    The goal of the ‘AI alignment’ field is to help future Artificial Intelligence systems become better aligned with human values. Thus, to achieve AI alignment, we might need a good theory of human values. A new approach called “Shard Theory” aims to develop such a theory of how humans develop values.
    My goal in this essay is to assess whether Shard Theory offers an empirically accurate model of human value formation, given what we know from behavior genetics about the heritability of human values. The stakes here are high. If Shard Theory becomes influential in guiding further alignment research, but if its model of human values is not accurate, then Shard Theory may not help improve AI safety.
    These kinds of empirical problems are not limited to Shard Theory. Many proposals that I’ve seen for AI ‘alignment with human values’ seem to ignore most of the research on human values in the behavioral and social sciences. I’ve tried to challenge this empirical neglect of value research in four previous essays for EA Forum, on the heterogeneity of value types in humans individuals, the diversity of values across individuals, the importance of body/corporeal values, and the importance of religious values.
    Note that this essay is a rough draft of some preliminary thoughts, and I welcome any feedback, comments, criticisms, and elaborations. In future essays I plan to critique Shard Theory from the perspectives of several other fields, such as evolutionary biology, animal behavior research, behaviorist learning theory, and evolutionary psychology.
    Background on Shard Theory
    Shard Theory has been developed mostly by Quintin Pope (a computer science Ph.D. student at Oregon State University) and Alex Turner (a post-doctoral researcher at the Center for Human-Compatible AI at UC Berkeley). Over the last few months, they posted a series of essays about Shard Theory on LessWrong.com, including this main essay here , ‘The shard theory of human values’ (dated Sept 3, 2022), plus auxiliary essays such as: ‘Human values & biases are not accessible to the genome’ (July 7, 2022), ‘Humans provide an untapped wealth of evidence about alignment’ (July 13, 2022), ‘Reward is not the optimizer’ (July 24, 2022), and ‘Evolution is a bad analogy for AGI: Inner alignment’ (Aug 13, 2022). [This is not a complete list of their Shard Theory writings; it’s just the set that seems most relevant to the critiques I’ll make in this essay.] Also, David Udell published this useful summary: ‘Shard Theory: An overview’ (Aug 10, 2022).
    There’s a lot to like about Shard Theory. It takes seriously the potentially catastrophic risks from AI. It understands that ‘AI alignment with human values’ requires some fairly well-developed notions about where human values come from, what they’re for, a...
    38 min
  • AF - Intelligent behaviour across systems, scales and substrates by Nora Ammann
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Intelligent behaviour across systems, scales and substrates, published by Nora Ammann on October 21, 2022 on The AI Alignment Forum.
    Tl;dr
    In an earlier post, I introduced a metaphor for thinking about the epistemic landscape of AI alignment, and then described three epistemic strategies for making progress on the alignment problem.
    In this post, I will double-click on the third strategy: learning from intelligence-in-the-wild. In particular, I will explore in more detail a core assumption this epistemic bet is based on—namely, that intelligent behaviour, as exhibited by different types of systems, both natural and artificial, share underlying principles which we can study and exploit.
    An epistemic bet: Learning from Intelligence-in-the-Wild
    Earlier, I defined the epistemic strategy of learning from intelligence-in-the-wild as follows:
    Finally, the third approach attempts to chart out the possibility space of intelligent behaviour by looking at how intelligent behaviour manifests in existing natural systems ([3] in Fig. 1).
    Instead of calling it a strategy, we could also call it an epistemic bet. This framing is helpful in emphasising the fact that in research, we are in the business of making bets. We cannot be entirely confident a given approach will bear fruit before we try it. But we can be more or less confident it will, and thus make informed bets. Furthermore, the term "bet" makes appeals to epistemic pluralism more intuitive (by reference to the reasons for why diversifying, say, one’s investment portfolio is a good idea).
    In the case of this specific bet, the hope is that by studying intelligent behaviour as it manifests in existing biological or social systems, and by recovering principles that govern complex systems across various scales and modalities of implementation, we can gain substantial insights into how to design intelligent behaviour (with certain desired properties) in artificial systems.
    Premise: Intelligent behaviour across systems, scales and substrates
    What reasons do we have to expect this strategy will be fruitful?
    The promise of this epistemic bet is, in part, premised on treating intelligent behaviour as a “real”, naturally occurring phenomenon, rather than, say, some theoretical or linguistic construct. Furthermore, intelligent behaviour - as we can observe it in different types of systems - shares underlying principles of functioning. As such, we can observe and investigate the phenomenon of intelligent behaviour in the real world and gain a substantive (i.e. predictive and explanatory) knoweldge of it that generalizes beyond specific substrates or modalities of implementation.
    To summarise:
    "Learning from intelligence-in-the-wild" - core assumptions:
    Epistemic access: We can improve our understanding of the nature and function of intelligent behaviour by looking at currently-existing systems that exhibit intelligent behaviour
    Substantive understanding: Intelligent behaviour is governed by principles that apply (at least in part) across modalities and scales of implementation and that we can investigate scientifically.
    Understanding intelligence: implementation-neutral principles and modalities of implementation-specificity
    In stipulating the existence of cross-system principles that govern intelligence behaviour, I do not mean to preclude that there also exist important differences between modalities and scales, i.e. aspects of intelligent behaviour that are implementation-specific/sensitive.
    The idea is to study intelligent behaviour (and related phenomena) as a (mostly) cross-system phenomenon, and one that is (mostly) substrate-neutral. But in order to draw useful insights from this approach, “mostly” is enough; it is not necessary to assume perfect parallels between different systems.
    We also learn about the functioning of intelli...
    21 min
  • EA - Brief evaluations of top-10 billionnaires by NunoSempere
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Brief evaluations of top-10 billionnaires, published by NunoSempere on October 21, 2022 on The Effective Altruism Forum.
    As part of my work with the Quantified Uncertainty Research Institute, I am experimenting with speculative evaluations that could be potentially scalable. Billionaires were an interesting evaluation target because there are a fair number of them, and at least some ate nominally aiming to do good.
    For now, for each top 10 billionaire, I have tried to get an idea of:
    How much value have they created through their business activities?
    How much impact have they created through their philanthropic activities
    I then assigned a subjective score based on my understanding of the answers to the above questions.
    Elon Musk (B)
    Elon Musk changes the world through:
    His businesses: Tesla, SpaceX, The Boring Company and Neuralink. Tesla makes better cars, SpaceX advances interplanetary expansion.
    His cultural influence: Twitter shitposting, conceiving and pushing for brighter futures, etc.
    His philanthropy: Little of it is publicly known so far. He will probably end up buying Twitter, partially with the intention of making it a better public good. OpenAI, which he helped found, might end up having greatly positive or greatly negative impact.
    Overall Musk seems like has produced large amounts of value, and might produce even more through SpaceX. But he also seems to be oddly nonstrategic at times.
    Bernard Arnault (D-)
    I see myself as an ambassador of French heritage and French culture. What we create is emblematic. It's linked to Versailles, to Marie Antoinette. -- Bernard Arnault, as quoted in Forbes
    His business produces little counterfactual value, and instead serves as a vehicle for conspicuous consumption. That is, if his luxury brands didn't exist, his customers would simply buy from the others, and the world would look extremely similar.
    His company describes its philanthropy as "an ideal expression of financial success", and supports art installations, or students attending concerts. Thus his philanthropy seems non-strategic, aimed at the display of wealth rather than at the firm pursuit of improving and fortifying French culture. He also donated $200M to restore the Notre Dame, which probably saved French tax-payers a similar amount.
    Jeff Bezos (B)
    The market value of Amazon is circa $1T, meaning that it has managed to capture at least that much value, and likely produced much more consumer surplus. His other ventures, like Blue Origin, are as of yet nowhere as valuable.
    Gautam Adani (B?)
    Adani seems to be a skilled manager, administrator, and deal-maker who, working in a developing country, has unlocked heaps of value.
    He has ties to Narenda Modi, and their fortunes have risen together. From the outside, it's hard to say to what extent he has created his wealth:
    The governor of Gujarat announced managerial outsourcing of the Mundra Port in 1994, and Adani got the contract in 1995, after which he set up the first jetty, which was originally run by Mundra Port & Special Economic Zone but was later transferred to Adani Ports and SEZ (APSEZ).
    Adani decided to turn it into a commercial port, building rail and road links to it by individually negotiating with over 50 0 landowners across India to create the largest port in India.
    or simply aquired it:
    Mr Adani’s friendship with Prime Minister Narendra Modi is time-tested. Their friendship goes back to 2003, when none of the country’s leading businessmen publicly stood by Modi’s side because of the handling of the Gujarat riots. But Adani broke ranks with the old business elite, potentially risking his future. And this gamble paid off.
    Gautam Adani is today one of the most visible tycoons in the country, whose prominence has accelerated in the years since Narendra Modi was elected prime minister in 2014. Since Mo...
    11 min
  • LW - AI Research Program Prediction Markets by tailcalled
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: AI Research Program Prediction Markets, published by tailcalled on October 20, 2022 on LessWrong.
    John Wentworth requested that someone would create prediction markets for various AI research programs. I've now done so, for four programs:
    Remember, though - Measure Lots Of Stuff: It would probably be good if other people made prediction markets that measured things from other angles. Make sure that you read John Wentworth's original post to know what is needed by alignment researchers.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    1 min