The Nonlinear Library

The Nonlinear Library

By The Nonlinear FundEducation
Download on the App Store

All The Nonlinear Library episodes

  • EA - On missing moods and tradeoffs by Lizka
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: On missing moods and tradeoffs, published by Lizka on May 9, 2023 on The Effective Altruism Forum.
    My favorite jargony phrase of the ~week is "missing mood."
    How I've been using it:
    If you're not feeling sad about some tradeoffs/facts about the world (or if you notice that someone else doesn't seem to be), then you might not be tracking something important (you might be biased, etc.). The “missing mood” is a signal.
    Note: I’m sharing this short post with some thoughts to hear disagreements, get other examples, and add nuance to my understanding of what’s going on. I might not be able to respond to all comments.
    Examples
    1. Immigration restrictions
    An example from the linked essay: immigration restrictions are sometimes justified. But "the reasonable restrictionist mood is anguish that a tremendous opportunity to enrich mankind and end poverty must go to waste." You might think that restricting immigration is sometimes the lesser evil, but if you don't have this mood, you're probably just ~xenophobic.
    2. Long content
    The example from Ben — a simplified sketch of our conversation:
    Me: How seriously do you hold your belief that “more people should have short attention spans?” And that long content is bad?
    Ben: I think I mostly just mean that there’s a missing mood: it’s ok to create long content, but you should be sad that you’re failing to communicate those ideas more concisely. I don’t think people are. (And content consumers should signal that they’d prefer shorter content.)
    (Related: Distillation and research debt, apparently Ben had written a shortform about this a year ago, and Using the “executive summary” style: writing that respects your reader’s time)
    3-6. Selective spaces, transparency, cause prioritization, and slowing AI
    I had been trying to (re)invent the phrase for situations like the following, where I want to see people acknowledging tradeoffs:
    Some spaces and events have restricted access. I think this is the right decision in many cases. But we should notice that it's sad to reject people from things, and there are negative effects from the fact that some people/groups can make those decisions.
    I want some groups of people to be more transparent and more widely accountable (and I frequently want to prioritize transparency-motivated projects on my team, and am sad when we drop them). In some cases, it's just true that I think transparency (or accountability) is more valuable than the other person does. But as I learn more about or start getting involved in any given situation, I usually notice that there are real tradeoffs; transparency has costs like time, risks, etc. There are two ways missing moods pop up in this case:
    When I'm just ~rallying for transparency, I'm missing a mood of "yes, it's costly in many ways, and it's awful that prioritizing transparency might mean that some good things don’t happen, but I still want more of it." If I don't have this mood, I might be biased by a vibe of "transparency good.” When I start thinking more about the tradeoffs, I sometimes entirely change my opinion to agree with the prioritization of whoever it is I’m disagreeing with. Alternatively, my position becomes closer to: "Ok, I don't really know what tradeoffs you're making, and you might be making the right ones. I'm sad that you don't seem to be valuing transparency that much. Or I just wish that you were transparent — I don't actually know how much you're valuing transparency."
    The people I’m disagreeing with might also be missing a mood. They might just not care about transparency or acknowledge its benefits. There’s a big difference (to me) between someone deciding not to prioritize transparency because the costs are too high and someone not valuing it at all, and if I’m not sensing the mood, it might be the latter. (This is especially true if I don’t h...
    6 min
  • EA - A note of caution on believing things on a gut level by Nathan Barnard
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: A note of caution on believing things on a gut level, published by Nathan Barnard on May 9, 2023 on The Effective Altruism Forum.
    Joe Carlsmith's latest post discusses the difference between the probabilities that one puts on events on a gut level and on a cognitive level, and advocates updating your gut beliefs towards your cognitive beliefs insofar as the latter better tracks the truth.
    The post briefly notes that there can be some negative mental health consequences of this. I would like to provide a personal anecdote of some of the costs (and benefits) of changing your gut beliefs to be in line with your cognitive ones.
    Around 6 months ago my gut realised that one day I was going to die, in all likelihood well before I would wish to. During this period, my gut also adopted the same cognitive beliefs I have about TAI and AI x-risk. All things considered, I expect this to have both decreased my impact from an impartial welfarist perspective and my personal life satisfaction by a substantial amount.
    Some of the costs for me of this have been:
    A substantial decrease in my altruistic motivation in favour of self-preservation
    A dramatic drop in my motivation to work
    Substantially worse ability to carry out causes prioritisation
    Depression
    Generically being a less clear thinker
    Differing my exams
    I expect to receive a somewhat lower mark in my degree than I otherwise would have
    Failing to run my university EA group well
    There have also been some benefits to this:
    I much more closely examined my beliefs about AI and AI X-risk
    Engaging quite deeply with some philosophy questions
    Note that this is just the experience of one individual and there are some good reasons to think that the net negative effects I've experienced won’t generalise:
    I’ve always been very good at acting on beliefs that I held at a cognitive level but not at a gut level. The upside therefore to me believing things at a gut level was always going to be small.
    I have a history of ruminative OCD (also known as pure O) - I almost without caveat recommend that others with ruminative OCD do not engage with potentially unpleasant beliefs one has at a cognitive level on a gut level.
    I’ve been experiencing some other difficulties in my life that probably made me more vulnerable to depression.
    In some EA and Rationalist circles, there’s a norm of being quite in touch with one’s emotions. I’m sure that this is very good for some people but I expect that it is quite harmful to others, including myself. For such individuals, there is an advantage to a certain level of detachment from one’s emotions. I say this because I think it’s somewhat lower status to reject engaging with one’s emotions and I think that this is probably harmful.
    As a final point, note that you are probably bad at affective forecasting. I’ve spent quite a lot of time reading about how people felt close to death and there are a wide variety of experiences. Some people do find that they are afraid own deaths when close to them, and others find that they have no fear. I’m particularly struck by De Gaulle’s recollections of his experiences during the first world war where he found he had no fear of death, after being shot leading his men during his early years in the war as a junior officer.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • LW - Solving the Mechanistic Interpretability challenges: EIS VII Challenge 1 by StefanHex
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Solving the Mechanistic Interpretability challenges: EIS VII Challenge 1, published by StefanHex on May 9, 2023 on LessWrong.
    We solved the first Mechanistic Interpretability challenge that Stephen Casper posed in EIS VII. We spent the last Alignment Jam hackathon attempting to solve the two challenges presented there, and present our (confirmed) solution to the CNN challenge here. We will present a write-up of our work on the Transformer challenge in a future post.Stefan and Marius submitted an early version of this work at the end of the Hackathon, and Stefan added Intervention and Causal Scrubbing tests to the final write-up. A notebook reproducing all results is provided here (requires no GPU but ~13 GB RAM).
    The challenges each provide a pre-trained network, and the task is to reverse engineer the network as well as to infer the labeling function used for training. The first challenge network is a MNIST CNN that takes MNIST images and outputs labels. The hints given are that [1] the labels are binary, [2] the test set accuracy is 95.58%, [3] that the (secret) labeling function is simple, and [4] this image:
    The MNIST network consists of
    2 Convolutional layers (Conv -> ReLU -> Dropout -> Pool)x2
    2 Fully connected layers (fc1[400,200] -> ReLU -> fc2[200,2])
    and we can access the data (torchvision.datasets.MNIST) but not the ground truth labels.
    Spoilers ahead!
    Summary of our solution (TL,DR)
    The inputs are labelled based on similarity with a 1 versus similarity with an inverted 1 ("anti-1"). If the difference is large (either clearly 1 or clearly anti-1) the image is labeled as class 0, otherwise the image is labeled as class 0. Specifically, the template for 1 seems to be is the given hint (clue_image), and the "anti-1" is 1-clue_image.
    The similarity is measured as the sum over the element-wise product of the image matrices (or equivalently dot product of flattened image arrays).Then the the ~17k most similar images to “1” and ~14k most similar images to “anti 1” are labelled class 1, the remaining ~29k images are labelled class 0. We can also phrase this as a band filter for similarity with (clue_image - 0.5), defining class 0 as where -17305 < (image (clue_image - 0.5)).sum() < -7762.We can observe this internally by looking at the embedding in the 200-neurons space, a PCA decomposition colored by label shows how the model judges this similarity:
    The model internally implements this via two groups of feature detectors (in the 200-dimensional neuron layer). These are “1-detectors” (detecting clue_image) and “anti-1-detectors” (detecting 1-clue_image). If either group fires sufficiently strongly, the model is classified as class 1, otherwise class 0.
    This classification has 96.2% overlap with model labels. Since the model itself has only 95.6% accuracy on the test set we think the difference is plausibly due to model error.
    We test our hypothesis with Causal Scrubbing. Specifically we test our hypothesis that of the 200 neurons there are 48 neurons detecting "1" similarity, 31 neurons detecting "anti-1" similarity, and 121 dead (useless) neurons. We resample-ablate all neurons by replacing each neurons activation with its activation on a different dataset example where our hypothesis predicts it to have a similar activation.
    Part 1: How we found this solution
    Since the model prediction depends on the logit (final neuron) difference we can directly say that in the final layer we only care about the logit of label 1 minus the logit of label 0, the logit diff direction. Then, using the [200,2] fc2 weight matrix (biases irrelevant) we can directly translate this logit diff direction into the 200-dim neuron space (by taking the difference of the respective weight vectors). We will make use of the logit diff directions at multiple points throughout the analysis.
    PCA ...
    18 min
  • LW - Making Up Baby Signs by jefftk
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Making Up Baby Signs, published by jefftk on May 9, 2023 on LessWrong.
    Babies are often mentally ready to start talking before they have enough control over their mouths, at a time when they may have enough control over their arms and hands to make simple gestures; a lot of otherwise verbal families have had good experiences with signing. If you look around online for baby sign resources, however,
    most of
    what
    you'll
    find involves long lists of specific signs, often simplified versions signs from American
    Sign Language.
    If you're just going to have a dozen signs that you use for a few months, however, a lot of the constraints that real sign languages like ASL have developed around aren't relevant. You're not building the foundation for something deep and expressive, you're developing a pidgin with your toddler to help fill a short gap in their capabilities. Which means you can prioritize the specific things your child wants to talk about, and use signs that are very easy for them to create and distinguish.
    For example, with our youngest we ended up with, in rough order of acquisition and maybe forgetting some:
    "more": bring hands together twice
    "light": open and close hand twice
    "diaper": tap side of butt twice
    "drink": tap mouth twice
    "pickle": tap side of head twice
    "peanut butter": tap inside of elbow twice
    "ice cream": tap bottom of chin twice
    "bran flakes": tap shoulder twice
    "all done": arms in a "w", wave hands twice
    "lift me up here": tap surface twice
    "outside": raise fist above head
    "umbrella": tap palm twice
    These are a mixture of ones we taught her ("more", "light", "drink"), ones she made up ("outside", "lift me up here"), and ones where we started teaching her something but what she ended up actually doing was pretty different ("all done", "ice cream"). Since all that matters is that we can understand each other, noticing what she's doing and going with that is fine.
    It's not a coincidence that many of these are "double tap somewhere". Once I realized she was picking those up well I started choosing that form for new signs. It's like, if your child was only going to use verbal speech for a short transition phase and no one in their life already used speech, you might use a lexicon like "baba" / "dada" / "mama" / "nana" / "gaga", allocated to whatever concepts they were most excited about expressing.
    She learned most of these signs she around 17m, during a period when she really wanted to communicate but her vocalizations weren't there yet. We taught one sign at a time, using it over and over until she had it reliably. Her older sisters were very excited to help, and would use it too in asking for things. At first we'd always give her what she asked for, and then later sometimes we'd acknowledge it but not give it to her ("ice cream? no more ice cream"). We wouldn't pretend not to understand her to avoid a request.
    This period was relatively short: by 20m most new things she wanted to say were vocal, and around 21m she started replacing her signs with vocalizations. At this point (22m) she'll still make some of the signs, but most of the time she'll say the word too.
    For comparison, our oldest was very verbal at a young age and only used a few signs ("more", "all done", "open"). I remember less with our middle child, but looking back at videos I think maybe she was even more verbal and only did "more"?
    Overall, it's definitely possible to go a lot further than we did with our youngest, but I feel like this level of depth was a good tradeoff for us, and our toddler really enjoyed being able to communicate more.
    Comment via: facebook, mastodon
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • AF - Solving the Mechanistic Interpretability challenges: EIS VII Challenge 1 by Stefan Heimersheim
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Solving the Mechanistic Interpretability challenges: EIS VII Challenge 1, published by Stefan Heimersheim on May 9, 2023 on The AI Alignment Forum.
    We solved the first Mechanistic Interpretability challenge that Stephen Casper posed in EIS VII. We spent the last Alignment Jam hackathon attempting to solve the two challenges presented there, and present our (confirmed) solution to the CNN challenge here. We will present a write-up of our work on the Transformer challenge in a future post.Stefan and Marius submitted an early version of this work at the end of the Hackathon, and Stefan added Intervention and Causal Scrubbing tests to the final write-up. A notebook reproducing all results is provided here (requires no GPU but ~13 GB RAM).
    The challenges each provide a pre-trained network, and the task is to reverse engineer the network as well as to infer the labeling function used for training. The first challenge network is a MNIST CNN that takes MNIST images and outputs labels. The hints given are that [1] the labels are binary, [2] the test set accuracy is 95.58%, [3] that the (secret) labeling function is simple, and [4] this image:
    The MNIST network consists of
    2 Convolutional layers (Conv -> ReLU -> Dropout -> Pool)x2
    2 Fully connected layers (fc1[400,200] -> ReLU -> fc2[200,2])
    and we can access the data (torchvision.datasets.MNIST) but not the ground truth labels.
    Spoilers ahead!
    Summary of our solution (TL,DR)
    The inputs are labelled based on similarity with a 1 versus similarity with an inverted 1 ("anti-1"). If the difference is large (either clearly 1 or clearly anti-1) the image is labeled as class 0, otherwise the image is labeled as class 0. Specifically, the template for 1 seems to be is the given hint (clue_image), and the "anti-1" is 1-clue_image.
    The similarity is measured as the sum over the element-wise product of the image matrices (or equivalently dot product of flattened image arrays).Then the the ~17k most similar images to “1” and ~14k most similar images to “anti 1” are labelled class 1, the remaining ~29k images are labelled class 0. We can also phrase this as a band filter for similarity with (clue_image - 0.5), defining class 0 as where -17305 < (image (clue_image - 0.5)).sum() < -7762.We can observe this internally by looking at the embedding in the 200-neurons space, a PCA decomposition colored by label shows how the model judges this similarity:
    The model internally implements this via two groups of feature detectors (in the 200-dimensional neuron layer). These are “1-detectors” (detecting clue_image) and “anti-1-detectors” (detecting 1-clue_image). If either group fires sufficiently strongly, the model is classified as class 1, otherwise class 0.
    This classification has 96.2% overlap with model labels. Since the model itself has only 95.6% accuracy on the test set we think the difference is plausibly due to model error.
    We test our hypothesis with Causal Scrubbing. Specifically we test our hypothesis that of the 200 neurons there are 48 neurons detecting "1" similarity, 31 neurons detecting "anti-1" similarity, and 121 dead (useless) neurons. We resample-ablate all neurons by replacing each neurons activation with its activation on a different dataset example where our hypothesis predicts it to have a similar activation.
    Part 1: How we found this solution
    Since the model prediction depends on the logit (final neuron) difference we can directly say that in the final layer we only care about the logit of label 1 minus the logit of label 0, the logit diff direction. Then, using the [200,2] fc2 weight matrix (biases irrelevant) we can directly translate this logit diff direction into the 200-dim neuron space (by taking the difference of the respective weight vectors). We will make use of the logit diff directions at multiple points through...
    18 min
  • LW - Result Of The Bounty/Contest To Explain Infra-Bayes In The Language Of Game Theory by johnswentworth
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Result Of The Bounty/Contest To Explain Infra-Bayes In The Language Of Game Theory, published by johnswentworth on May 9, 2023 on LessWrong.
    A month and a half ago I announced a $500 bounty/prize to explain infrabayes work in the language of game theory. Others added another $980 to the prize pool.
    There were no entries which did exactly the thing I asked for, but we did get one post which I think provided an excellent 80/20. Or, well, almost 80/20, as implied by the payout: I have decided to pay out 75% of the prize money to David Matolcsi's A very non-technical explanation of the basics of infra-Bayesianism.
    David's post is the best conceptual explanation I have seen to date of the core ideas of infra-bayes. It is the only intro I've seen which presents things in a significantly different conceptual frame/language than the original, which I think is very much necessary in order to understand what's going on. After reading it, I feel like I have a decent intuitive idea of what infrabayes does/doesn't do, and roughly how/why it does/doesn't do those things.
    The main thing David's post does not do is explicitly tie any of the concepts to the math. Or use any math at all. Which is a reasonable choice - as I said, 80/20(ish).
    Thankyou David for writing a very useful post! Again, the post is A very non-technical explanation of the basics of infra-Bayesianism, and I strongly recommend it for anyone who wants an intuitive understanding of what's going on with infrabayes.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Announcing “Key Phenomena in AI Risk” (facilitated reading group) by Nora Ammann
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Announcing “Key Phenomena in AI Risk” (facilitated reading group), published by Nora Ammann on May 9, 2023 on LessWrong.
    TLDR: “Key Phenomena in AI Risk” is a 7 week-long, facilitated reading group. It is aimed at people interested in conceptual AI alignment research, in particular from fields such as philosophy, systems research, biology, cognitive and social sciences.
    The program will run between July and August 2023. Sign up here by May 28th.
    What?
    The “Key Phenomena in AI risk” reading curriculum provides an extended introduction to some key ideas in AI risk, in particular risks from misdirected optimization or 'consequentialist cognition'. As such, it aims to remain largely agnostic of solution paradigms.
    See here for a short overview of the curriculum; here for a more extensive summary; and here for the full curriculum.
    This is a 7-week long program, which consists of a weekly 90’ facilitated call to discuss the week’s key phenomena and readings, as well as individual time for reading (min. 2h, more if you would like to explore the optional readings).
    The courses are virtual and free of charge.
    For Who?
    The curriculum is primarily aimed at people interested in conceptual research in AI risk and alignment.
    It is designed to be accessible to audiences in, among others, philosophy (of agency, knowledge, power, etc.) and systems research (e.g. biological, cognitive, information-theoretic, social systems, etc.).
    When?
    The reading groups will be taking place in July and August 2023.
    We expect to run 2-6 groups à 4-8 participants (including 1 facilitator). Each group will be led by a facilitator with substantive knowledge of AI risk.
    Overview of the curriculum
    Week 0 is dedicated to getting to know each other and clarifying how the program will work.
    Week 1 focuses on why important features of generally intelligent 'consequentialist cognition' might be algorithmically realizable, and its potential implications.
    Week 2 focuses on why it can be hard to direct such intelligence in a safe and beneficial direction.
    Week 3 discusses instrumental convergence in goal-oriented systems. .
    Week 4 discusses risks from systems that seek predictive omniscience.
    Week 5 discusses some factors on why surveilling (or oversight of) these artificial systems may be fraught with differential advantage for deceptive tendencies.
    Week 6 discusses why even an incoherent aggregation of optimizing systems could still impose a (misaligned) optimizing pressure in the world.
    Here is a longer summary. Here is the full curriculum.
    The curriculum has been developed by TJ (Research Scholar FHI) with inputs from Nora Ammann, Sahil Kulshrestha, and Tsvi Benson-Tilsen. The program is operationally supported by PIBBSS.
    The curriculum was initially developed as part of the PIBBSS summer research fellowship,. but we realized that it might be of interest and useful to people outside of the fellowship program, too.
    We are orienting to this present round of reading groups as a way to test whether it’s worth continuing to run them on a more regular basis, as well so to help us improve the program.
    Sign up
    Sign up here by May 28th.
    About the application
    The application consists of one stage, where we ask you to fill in a form with
    Your CV
    Your motivation for participating in the program
    Your prior exposure to AI risk/alignment to date
    We select people based on our best understanding of their motivation to contribute to AI alignment and how much they would counterfactually benefit from participating in the program.
    If you have any questions, feel free to leave a comment below or contact us at [email protected]
    If you are keen to facilitate one of the reading group, also reach out.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    4 min
  • EA - [AISN #5]: Geoffrey Hinton speaks out on AI risk, the White House meets with AI labs, and Trojan attacks on language models by Center for AI Safety
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: [AISN #5]: Geoffrey Hinton speaks out on AI risk, the White House meets with AI labs, and Trojan attacks on language models, published by Center for AI Safety on May 9, 2023 on The Effective Altruism Forum.
    Welcome to the AI Safety Newsletter by the Center for AI Safety. We discuss developments in AI and AI safety. No technical background required.
    Subscribe here to receive future versions.
    Geoffrey Hinton is concerned about existential risks from AI
    Geoffrey Hinton won the Turing Award for his work on AI. Now he says that part of him regrets his life’s work, as he believes that AI poses an existential threat to humanity. As Hinton puts it, “it’s quite conceivable that humanity is just a passing phase in the evolution of intelligence.”
    AI is developing more rapidly than Hinton expected. In 2015, Andrew Ng argued that worrying about AI risk is like worrying about overpopulation on Mars. Geoffrey Hinton also used to believe that advanced AI was decades away, but recent progress has changed his views. Now he says that AI will become “smarter than a human” in “5 to 20 years, but without much confidence. We live in very uncertain times.”
    The AI race is heating up, but Hinton sees a way out. In an interview with MIT Technology Review, Hinton argues that building AI is “inevitable” given competition between companies and countries. But he argues that “we’re all in the same boat with respect to existential risk,” so potentially “we could get the US and China to agree like we could with nuclear weapons.”
    Similar to climate change, AI risk will require coordination to solve. Hinton compared the two risks by saying, "I wouldn't like to devalue climate change. I wouldn't like to say, 'You shouldn't worry about climate change.' That's a huge risk too. But I think this might end up being more urgent."
    When AIs create their own subgoals, they will seek power. Hinton argues that AI agents like AutoGPT and BabyAGI demonstrate that people will build AIs that choose their own goals and pursue them. Hinton and others have argued that this is dangerous because “getting more control is a very good subgoal because it helps you achieve other goals.”
    Other experts are speaking up on AI risk. Demis Hassabis, CEO of DeepMind, recently said that he believes some form of AGI is “a few years, maybe within a decade away” and recommended “developing these types of AGI technologies in a cautious manner.” Shane Legg, co-founder of DeepMind, thinks AGI is likely to arrive around 2026. Warren Buffet compared AI to the nuclear bomb, and many others are concerned about advanced AI.
    White House meets with AI labs
    Vice President Kamala Harris met at the White House on Thursday with leaders of Microsoft, Google, Anthropic, and OpenAI to discuss risks from artificial intelligence. This is an important step towards AI governance, though it’s a bit like inviting oil companies to a discussion on climate change—they have the power to solve the problem, but incentives to ignore it.
    New executive action on AI. After the meeting, the White House outlined three steps they plan to take to continue responding to the challenges posed by AI:
    To evaluate the risks of generative AI models, the White House will facilitate a public red-teaming competition. The event will take place at the DEF CON 31 conference and will feature cutting-edge models provided by leading AI labs.
    The White House continues to support investments in AI research, such as committing $140M over 5 years to National AI Research Institutes. Unfortunately, it’s plausible that most of this investment will be used to accelerate AI development without being directed at making these systems more safe.
    The Office of Management and Budget will release guidelines for federal use of AI.
    Federal agencies promise enforcement action on AI. Four federal agencies iss...
    8 min
  • AF - Result Of The Bounty/Contest To Explain Infra-Bayes In The Language Of Game Theory by johnswentworth
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Result Of The Bounty/Contest To Explain Infra-Bayes In The Language Of Game Theory, published by johnswentworth on May 9, 2023 on The AI Alignment Forum.
    A month and a half ago I announced a $500 bounty/prize to explain infrabayes work in the language of game theory. Others added another $980 to the prize pool.
    There were no entries which did exactly the thing I asked for, but we did get one post which I think provided an excellent 80/20. Or, well, almost 80/20, as implied by the payout: I have decided to pay out 75% of the prize money to David Matolcsi's A very non-technical explanation of the basics of infra-Bayesianism.
    David's post is the best conceptual explanation I have seen to date of the core ideas of infra-bayes. It is the only intro I've seen which presents things in a significantly different conceptual frame/language than the original, which I think is very much necessary in order to understand what's going on. After reading it, I feel like I have a decent intuitive idea of what infrabayes does/doesn't do, and roughly how/why it does/doesn't do those things.
    The main thing David's post does not do is explicitly tie any of the concepts to the math. Or use any math at all. Which is a reasonable choice - as I said, 80/20(ish).
    Thankyou David for writing a very useful post! Again, the post is A very non-technical explanation of the basics of infra-Bayesianism, and I strongly recommend it for anyone who wants an intuitive understanding of what's going on with infrabayes.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    2 min
  • LW - Tools for finding information on the internet by RomanHauksson
    Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Tools for finding information on the internet, published by RomanHauksson on May 9, 2023 on LessWrong.
    Isn't the internet such a magically useful tool? Thirty years ago, if you wanted to know how many plays Shakespeare wrote, you would have to physically walk to your local library and find a relevant book. Now, you can find the answer in less than ten seconds, at any time, wherever you are.
    However, the internet is not a truthful, superintelligent oracle. Rather, it's a dangerous jungle of knowledge you must learn to navigate if you wish to find the truth. Good information is censored, hidden behind paywalls or within piles of spam, and difficult to differentiate from untrustworthy information. This post won't be a complete guide on how to navigate the world wide web of knowledge, but it will give you some tools I've discovered over the years that you can throw in your digital rucksack to aid your journey.
    Search engines
    The great internet sage Gwern Branwen wrote an advanced guide on finding ref­er­ences, pa­pers, and books on­line.
    The search engines Brave Search and Kagi have the features "Goggles" and "Lenses" respectively, which are presets that filter or re-rank entire categories of websites in your results.
    SearXNG is a highly customizable internet metasearch engine.
    Perplexity uses natural language processing to answer your query with a paragraph (with sources) and allows you to ask followup questions.
    Metaphor allows you to find websites by writing creative and long-form prompts, also using NLP.
    Elicit is a research assistant that helps you find relevant research papers, also using NLP.
    Bypassing restrictions
    Sometimes you know exactly where to find a piece of information, but it's locked behind a paywall or deleted from the internet.
    Unddit displays deleted comments and posts on Reddit.
    Internet Archive is a non-profit library of free books, movies, websites, et cetera. It's famous for the Wayback Machine, which displays past archived snapshots of a given URL.
    Bypass Paywalls is a browser extension to help bypass paywalls on selected sites.
    The subreddit r/piracy has a wiki with loads of resources on obtaining copyrighted material for free.
    Anna's Archive is a shadow library metasearch engine that aggregates results from websites that host copyrighted books, academic papers, magazines, et cetera.
    Trustworthy sources
    It is particularly frustrating to find trustworthy knowledge about certain topics because of misaligned incentives: researching which product to buy or which supplements actually work is hard because everyone's trying to sell you something.
    Consumer Reports independently tests consumer products and gives in-depth recommendations. It does not rely on affiliate commissions.
    Examine is a database of research about nutrition and supplements that has no industry ties, sponsorships, or ads.
    Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org.
    3 min