LessWrong (30+ Karma)

“Help us find founders for new AI safety projects” by lukeprog

Listen Later

In the past 10 years, Coefficient Giving (formerly Open Philanthropy) has funded dozens of projects doing important work related to AI safety / navigating transformative AI. And yet, perhaps most activities that would improve expected outcomes from transformative AI have no significant project pushing them forward, let alone multiple.

This is mainly because we and other funders in the space don't receive promising applications for most desirable activities, and so massive gaps in the ecosystem remain, for example:

[[1]]

  • Policy development, advising, and advocacy in many important but currently neglected countries.
  • Projects to develop and advocate for better model specifications.
  • Projects to fill key gaps in AI infosecurity, e.g. software to allow the ~entire frontier AI model development and deployment workflow to run in a confidential computing environment, or router software that would improve companies' ability to detect and block weight exfiltration attempts.
  • Projects developing and deploying new tools for detecting and monitoring dangerous AI behaviors in the wild.
  • Projects to build better de-escalation mechanisms for companies and countries, a la Catalink.
  • Projects to build a more robust incident tracking and reporting ecosystem.
  • Projects to build and promote new [...]

    • The original text contained 1 footnote which was omitted from this narration.

    ---

    First published:

    December 4th, 2025

    Source:

    https://www.lesswrong.com/posts/uKfvwT3PjwZhAtcjW/help-us-find-founders-for-new-ai-safety-projects

    ---

    Narrated by TYPE III AUDIO.

    ...more
    View all episodesView all episodes
    Download on the App Store
    LessWrong (30+ Karma)By LessWrong

    More shows like LessWrong (30+ Karma)

    View all
    Making Sense with Sam Harris by Sam Harris

    Making Sense with Sam Harris

    26,370 Listeners

    Conversations with Tyler by Mercatus Center at George Mason University

    Conversations with Tyler

    2,450 Listeners

    The Peter Attia Drive by Peter Attia, MD

    The Peter Attia Drive

    8,708 Listeners

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

    Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

    4,174 Listeners

    ManifoldOne by Steve Hsu

    ManifoldOne

    93 Listeners

    Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Daniel Barcay and Aza Raskin

    Your Undivided Attention

    1,599 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    9,855 Listeners

    Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

    Machine Learning Street Talk (MLST)

    93 Listeners

    Dwarkesh Podcast by Dwarkesh Patel

    Dwarkesh Podcast

    507 Listeners

    Hard Fork by The New York Times

    Hard Fork

    5,529 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    16,019 Listeners

    Moonshots with Peter Diamandis by PHD Ventures

    Moonshots with Peter Diamandis

    543 Listeners

    No Priors: Artificial Intelligence | Technology | Startups by Conviction

    No Priors: Artificial Intelligence | Technology | Startups

    136 Listeners

    Latent Space: The AI Engineer Podcast by swyx + Alessio

    Latent Space: The AI Engineer Podcast

    94 Listeners

    BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

    BG2Pod with Brad Gerstner and Bill Gurley

    475 Listeners