Gustavs Zilgalvis is a technology and security policy fellow within RAND's Global and Emerging Risks Division, a Ford Dorsey Master's in International Policy candidate at Stanford's Freeman Spogli Institute for International Studies, and a founding Director at the Center for Space Governance. At RAND, he is specializing in the geopolitical and economic implications of the development of artificial intelligence. Previously, Zilgalvis has written about the interface of space and artificial intelligence in Frontiers of Space Technology, held a Summer Research Fellowship on artificial intelligence at Oxford's Future of Humanity Institute, and his research in computational high-energy physics has appeared in SciPost Physics and SciPost Physics Core. Zilgalvis holds a Bachelor of Science with First-Class Honors in Theoretical Physics from University College London, and graduated first in his class from the European School Brussels II.

About Foresight Institute

Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.

Allison Duettmann

The President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".

Get Involved with Foresight:

• Apply to our virtual technical seminars 
• Join our in-person events and workshops 
• Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!

Follow Us: Twitter | Facebook | LinkedIn

Note: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.

Hosted on Acast. See acast.com/privacy for more information.

Speaker

Amanda Ngo is a 2024 Foresight Fellow. Recently, she has built Elicit.org from inception to 100k+ monthly users, leading a team of 5 engineers and designers, presented on forecasting, safe AI systems, and LLM research tools at conferences (EAG, Foresight Institute), ran a 60-person hackathon with FiftyYears using LLMs to improve our wellbeing (event, write up), analyzed Ideal Parent Figure transcripts and built an automated IPF chatbot (demo), and co-organized a 400-person retreat for Interact, a technology for social good fellowship.

Session Summary

“Imagine waking up every day in a state of flow, where all the knots and fears are replaced with a deep sense of ease and joy.”

This week we are dropping another special episode of the Existential Hope podcast, featuring Amanda Ngo, a Foresight Institute Existential Hope fellow specializing in AI innovation for wellbeing. Amanda speaks about her work on leveraging AI to enhance human flourishing, sharing insights on the latest advancements and their potential impacts. Her app: https://www.mysunrise.app/

Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcasts

Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.

Hosted by Allison Duettmann and Beatrice Erkers

Follow Us: Twitter | Facebook | LinkedIn | Existential Hope Instagram

Explore every word spoken on this podcast through Fathom.fm.

Hosted on Acast. See acast.com/privacy for more information.

Jeffrey Ladish

Before starting Palisade, Jeffrey helped build out the information security program at Anthropic through his security consulting company, Gordian. Jeffrey has also helped dozens of tech companies, philanthropic organizations, and existential-risk-focused projects get started with secure infrastructure.

Summary

Ladish discusses the increasing sophistication and proliferation of deepfake technology, which allows AI to mimic human voices and faces, and its potential for widespread deception. He argues that this increasingly capable technology is and will be used to spread fake information, manipulate elections or markets, create deepfake pornography, and generate fake endorsements from actors or organizations.

About Foresight Institute

Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.

Allison Duettmann

The President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".

Get Involved with Foresight:

• Apply: Virtual Salons & in-person Workshops
• Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!

Follow Us: Twitter | Facebook | LinkedIn

Note: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.

Hosted on Acast. See acast.com/privacy for more information.

Speaker

Kristian Rönn is the CEO and co-founder of Normative. He has a background in mathematics, philosophy, computer science and artificial intelligence. Before he started Normative he worked at the University of Oxford’s Future of Humanity Institute on issues related to global catastrophic risks.

Session Summary

When people talk about today’s biggest challenges they tend to frame the conversation around “bad people” doing “bad things.” But is there more to the story?

In this month’s Hope Drop we speak to Kristian Rönn, an entrepreneur formerly affiliated with the Future of Humanity Institute. Kristian calls these deeply rooted impulses “Darwinian demons.” These forces, a by-product of natural selection, can lead us to act in shortsighted ways that harm others—and even imperil our survival as a species. In our latest episode, Kristian explains how we can escape these evolutionary traps through cooperation and innovative thinking. Kristian's new book, The Darwinian Trap, is being published on September 24th. Be sure to preorder it today!

Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcasts

Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.

Hosted by Allison Duettmann and Beatrice Erkers

Follow Us: Twitter | Facebook | LinkedIn | Existential Hope Instagram

Explore every word spoken on this podcast through Fathom.fm.

Hosted on Acast. See acast.com/privacy for more information.

Speaker 

Divya is the co-founder of the Collective Intelligence Project, which advances collective intelligence capabilities for the democratic and effective governance of transformative technologies. She serves as Associate Political Economist and Social Technologist at Microsoft’s Office of the CTO. She also holds positions as a research director at Metagov and a researcher in residence at the RadicalXChange Foundation.

Key Highlights

In today’s rapidly evolving world, where technology is at the forefront of progress, the need for effective collaboration between humans and artificial intelligence is more crucial than ever. In this engaging and thought-provoking talk, we will explore the concept of collective intelligence and discuss how it can be harnessed to drive collective progress in various domains, including science, technology, and social innovation.

About Foresight Institute

Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.

Allison Duettmann

The President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".

Get Involved with Foresight:

• Apply: Virtual Salons & in-person Workshops
• Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!

Follow Us: Twitter | Facebook | LinkedIn

Note: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.

Hosted on Acast. See acast.com/privacy for more information.

Speaker

Siméon Campos is president and founder of SaferAI, an organization working on developing the infrastructure for general-purpose AI auditing and risk management. He worked on large language models for the last two years and is highly committed to making AI safer.

Session Summary

“I think safe AGI can both prevent a catastrophe and offer a very promising pathway into a eucatastrophe.”

This week we are dropping a special episode of the Existential Hope podcast, where we sit down with Siméon Campos, president and founder of Safer AI, and a Foresight Institute fellow in the Existential Hope track. Siméon shares his experience working on AI governance, discusses the current state and future of large language models, and explores crucial measures needed to guide AI for the greater good.

Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcasts

Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.

Hosted by Allison Duettmann and Beatrice Erkers

Follow Us: Twitter | Facebook | LinkedIn | Existential Hope Instagram

Explore every word spoken on this podcast through Fathom.fm.

Hosted on Acast. See acast.com/privacy for more information.

Speaker 

Dean Woodley Ball is a Research Fellow at George Mason University’s Mercatus Center and author of the Substack Hyperdimensional. His work focuses on artificial intelligence, emerging technologies, and the future of governance. Previously, he was Senior Program Manager for the Hoover Institution's State and Local Governance Initiative. 

Key Highlights

Based on engagement with the neuroscience and machine learning literatures, this talk will focus on how technologies such as virtual reality, large language models, AI agents, neurostimulation, and neuromonitoring may converge in the coming decade into the first widespread consumer neural technology. The talk will focus on technical feasibility, public policy, and broader societal implications. 

In terms of the challenge, I think the big one for me is probably building the datasets we’ll need for the foundational AI models undergirding all of this.

About Foresight Institute

Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.

Allison Duettmann

The President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".

Get Involved with Foresight:

• Apply: Virtual Salons & in-person Workshops
• Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!

Follow Us: Twitter | Facebook | LinkedIn

Note: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.

Hosted on Acast. See acast.com/privacy for more information.

Dr. Watt is an investment associate at Ascension Ventures, an investment firm specializing in healthcare technology. She previously co-founded and served as CSO of Pro-Arc Diagnostics, a personalized medicine company operating in St. Louis.

Key Highlights

Watt discusses her career journey and insights into venture capital investing in neuroscience and neurotech companies. She explains her role as a VC, which involves making profitable investments, underwriting risk, and structuring deals. Dana highlights key attributes of venture-backable companies, such as exceptional teams, large addressable markets, defensibility, and differentiation. She also discusses challenges and biases in neuroscience investing, including the complexity of brain science, hardware difficulties, long clinical timelines, and subtle readouts.

About Foresight Institute

Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.

Allison Duettmann

The President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".

Get Involved with Foresight:

• Apply: Virtual Salons & in-person Workshops
• Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!

Follow Us: Twitter | Facebook | LinkedIn

Note: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.

Hosted on Acast. See acast.com/privacy for more information.

James Pethokoukis is a senior fellow and the DeWitt Wallace Chair at the American Enterprise Institute, where he analyzes US economic policy, writes and edits the AEIdeas blog, and hosts AEI’s Political Economy podcast. He is also a contributor to CNBC and writes the Faster, Please! newsletter on Substack. He is the author of The Conservative Futurist: How to Create the Sci-Fi World We Were Promised (Center Street, 2023). He has also written for many publications, including the Atlantic, Commentary, Financial Times, Investor’s Business Daily, National Review, New York Post, the New York Times, USA Today, and the Week. 

Session Summary

In this episode, James joins us to discuss his book, The Conservative Futurist, and his perspectives on technology and economic growth. James explores his background, the spectrum of 'upwing' (pro-progress) versus 'downwing' (anti-progress), and the role of technology in solving global challenges. He explains his reasoning for being pro-progress and pro-growth as well as highlighting the importance of positive storytelling and education in developing a more advanced and prosperous world.

Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcasts

Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.

Hosted by Allison Duettmann and Beatrice Erkers

Follow Us: Twitter | Facebook | LinkedIn | Existential Hope Instagram

Explore every word spoken on this podcast through Fathom.fm.

Hosted on Acast. See acast.com/privacy for more information.

The Flourishing Foundation

In February 2024, we partnered with the Future of Life Institute on a hackathon to design institutions that can guide and govern the development of AI. The winner of the hackathon was the Flourishing Foundation, who are focused on our relationship with AI and other emerging technologies. They challenge innovators to envision and build life-centered products, services, and systems, specifcially, to enable TAI-enabled consumer technologies to promote human well-being by developing new norms, processes, and community-driven ecosystems.

At their core, they explore the question of "Can AI make us happier?"

Connect: https://www.flourishing.foundation/

Read about the hackathon: https://foresight.org/2024-xhope-hackathon/

Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.

Hosted by Allison Duettmann and Beatrice Erkers

Follow Us: Twitter | Facebook | LinkedIn | Existential Hope Instagram

Explore every word spoken on this podcast through Fathom.fm.

Hosted on Acast. See acast.com/privacy for more information.