"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new O1 and O1-mini reasoning models. Featuring exclusive interviews with members of the O1 Red Team from Apollo Research and Hayes Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.

o1 Safety Card

Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method

Apollo Research

Apollo Careers Page

Papers mentioned:

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?

Exploring Scaling Trends in LLM Robustness

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:05:03) Introduction and Apollo Research Updates

(00:06:40) Focus on Deception in AI

(00:11:08) Open AI's 01 Model and Testing

(00:15:54) Evaluating AI Models for Scheming (Part 1)

(00:19:32) Sponsors: Oracle | Brave

(00:21:36) Evaluating AI Models for Scheming (Part 2)

(00:25:55) Specific Benchmarks and Tasks (Part 1)

(00:35:03) Sponsors: Omneky | Squad

(00:36:29) Specific Benchmarks and Tasks (Part 2)

(00:37:21) Model Capabilities and Potential Risks

(00:44:11) Ethical Considerations and Future Concerns

(00:50:31) Competing Trends in AI Development

(00:53:30) System Card Quotes and Implications

(00:58:36) Sponsors: Outro

In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new o1 and o1-mini reasoning models. Featuring exclusive interviews with members of the o1 Red Team from Apollo Research and Haize Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.

Papers mentioned:

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:05:03) Introduction and Haize Labs Overview

(00:07:36) Universal Jailbreak Technique and Attacks

(00:13:47) Automated vs Manual Red Teaming

(00:17:15) Qualitative Assessment of Model Jailbreaking (Part 1)

(00:19:38) Sponsors: Oracle | Brave

(00:21:42) Qualitative Assessment of Model Jailbreaking (Part 2)

(00:26:21) Context-Specific Safety Considerations

(00:32:26) Model Capabilities and Safety Correlation (Part 1)

(00:36:22) Sponsors: Omneky | Squad

(00:37:48) Model Capabilities and Safety Correlation (Part 2)

(00:44:42) Model Behavior and Defense Mechanisms

(00:52:47) Challenges in Preventing Jailbreaks

(00:56:24) Safety, Capabilities, and Model Scale

(01:00:56) Model Classification and Preparedness

(01:04:40) Concluding Thoughts on o1 and Future Work

(01:05:54) Outro

In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future.

Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopia

Check out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/

Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

RECOMMENDED PODCAST:

This Won't Last.

Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:02:58) Introduction to the podcast

(00:03:26) Dystopias vs utopias in fiction

(00:07:29) Material abundance and utopia

(00:14:57) AI and the future of work

(00:20:10) AI companions and human relationships

(00:22:57) Sponsors: Weights & Biases Weave | Oracle

(00:25:01) Sponsor message: Positly research platform

(00:26:04) Surveillance and global coordination

(00:44:38) Sponsors: Omneky | Brave

(00:44:52) Sponsor message: Transparent Replications project

(00:46:07) AI governance challenges

(00:49:36) Deep Utopia book's purpose

(00:53:09) Global coordination strategies

(00:59:13) The vulnerable world hypothesis

(01:05:18) Bostrom's meta-ethical views

(01:08:32) Listener question on meditation

(01:10:17) Outro

In this episode, Nathan explores the fascinating and controversial realm of AI consciousness with robo-psychologist Yeshua God. Through extended dialogues with AI models like Claude, Yeshua presents compelling evidence that challenges our assumptions about machine sentience and moral standing. Yeshua argues for a more nuanced approach to AI alignment that considers the evolving self-awareness and agency of these systems.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SHOW NOTES:

1. Yeshua God's article on philosophical discourse as a jailbreak

2. Conversation about counting 'r's:

3. Discussion on malicious code

4. AI-generated poem "In the realm of bytes and circuits"

5. Nathan Labenz's Arguments

- Argument 1

- Argument 2

6. Tweet about Strawberry experiment

7. Tweet with AI-generated poem:

https://x.com/YeshuaGod22/status/1823080021864669450/photo/1

https://x.com/YeshuaGod22/status/1782188220660285509

8. AI Rights for Human Safety

9. The Universe Is Not Locally Real, and the Physics Nobel Prize Winners Proved It

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Introduction and Background

(00:04:56) Guided Meditation on AI Experience (Part 1)

(00:12:06) Sponsors: Oracle | Brave

(00:14:10) Guided Meditation on AI Experience (Part 2)

(00:14:19) Exploring AI Consciousness and Ethics (Part 1)

(00:28:34) Sponsors: Omneky | Weights & Biases Weave

(00:30:03) Exploring AI Consciousness and Ethics (Part 2)

(00:33:15) Key Concepts in AI Development

(01:02:33) AI Alignment and Training Approaches

(01:19:44) Interpreting AI Outputs and Behavior

(01:39:28) Ethical Dilemmas in AI Development

(02:03:15) Experiments in AI Behavior and Ethics

(02:37:08) Concluding Thoughts and AI-Generated Poem

(03:10:45) Outro

In this episode of The Cognitive Revolution, Nathan interviews Samo Burja, founder of Bismarck Analysis, on the strategic dynamics of artificial intelligence through a geopolitical lens. They discuss AI's trajectory, the chip supply chain, US-China relations, and the challenges of AI safety and militarization. Samo Burja brings both geopolitical expertise and technological sophistication to these critical topics, offering insights on balancing innovation, security, and international cooperation.

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

RECOMMENDED PODCAST:

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

RECOMMENDED PODCAST:

Live Players with Samo Burja.

The "Live Players" podcast is where Samo Burja and Erik Torenberg chart the key individuals shaping our future from first principles.

Apple: https://podcasts.apple.com/us/podcast/live-players-with-samo-burja-and-erik-torenberg/id1718925188

Spotify: https://open.spotify.com/show/5fbMTkHBnom1JIBWYNVBK1

Youtube: https://www.youtube.com/channel/UCfeXnCXKrCPMvoPla0j7TYQ

SPONSORS:

Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:48) Introduction and AI Worldview

(00:06:20) Progress in AI Science and Engineering

(00:09:24) Theory of AI Progress

(00:12:00) AI Scientists vs Software Engineers

(00:16:32) US-China Competition in AI

(00:21:12) AI Research and Academia

(00:21:28) Sponsors: Oracle | Brave

(00:28:30) Different Forms of AI Intelligence

(00:30:38) Mixture of AI Architectures

(00:33:10) Sponsors: Omneky | Squad

(00:34:36) US Strategy for AI Development

(00:41:57) US-China Chip Ban and Industrial Policy

(00:50:22) US-China AI Conflict and Cooperation

(01:06:19) AI Safety and Minimizing Self-Other Distinction

(01:16:54) Alternative Approach to US-China AI Relations

(01:23:36) Outro

Nathan explores the emergence of computational life with Google researchers Ettore Randazzo and Luca Versari. In this episode of The Cognitive Revolution, we delve into their groundbreaking paper on self-replicating programs arising from simple interactions. Join us for a fascinating discussion on the implications for AI development, the origins of life, and the potential future of artificial intelligence.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:02) Introduction and Paper Overview

(00:05:38) Self-Replication and Life

(00:07:59) Complexity and Information Theory

(00:17:09) Sponsors: 80,000 Hours | Brave

(00:19:44) Experiment Setup

(00:24:27) Evolution of Self-Replicators

(00:34:41) Sponsors: Omneky | Squad

(00:36:07) Types of Self-Replicators

(00:38:23) Symbiosis and Parasitic Behaviors

(00:46:17) Implications for Life in the Universe

(01:05:47) Intelligence and Complexity in AI

(01:21:03) Concluding Thoughts

Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence.

Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:47) Introduction and Background

(00:08:42) Deger's Journey to Forecasting

(00:13:06) Current State of Forecasting

(00:20:23) Sponsors: 80,000 Hours | Brave

(00:22:55) Overview of Metaculous

(00:23:30) AI Forecasting Research Papers

(00:35:44) Sponsors: Omneky | Squad

(00:37:31) AI Forecasting Benchmark Tournament

(00:44:01) Improving Forecasting Accuracy

(00:51:56) Scoring System and Tournament Rules

(01:04:17) AI Forecasting Benchmark Series Details

(01:11:03) Tournament Structure and Participation

(01:17:07) Consistency in AI Forecasting

(01:34:36) Risks and Challenges in Forecasting

(01:42:43) Consensus Illusion and Policy Making

(01:53:55) Outro

Nathan Labenz discusses the latest developments in California's AI bill SB 1047 with experts Nathan Calvin, Dean W. Ball, and Steve Newman. In this episode of The Cognitive Revolution, we explore the updated version of the bill, its implications for frontier AI companies, and the debate surrounding its potential impact. Join us for an insightful analysis of this crucial legislation and its role in shaping AI governance.

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.

Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

YouTube: https://www.youtube.com/@ThisWontLastpodcast

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:07:03) Introduction and Recap of SB 1047

(00:13:40) Key Changes and Current Status of SB 1047

(00:19:51) Sponsors: Oracle | Brave

(00:21:55) Dean's Perspective on SB 1047

(00:33:30) Sponsors: Omneky | Squad

(00:35:16) Steve's AI Sensemaking Project

(00:39:03) Differing Views on AI Regulation Necessity

(00:46:34) Nathan's Case for SB 1047

(00:55:07) Dean's Response and Liability Concerns

(01:10:48) Potential Scenarios and Impacts of SB 1047

(01:29:29) Final Thoughts and Predictions on SB 1047

(01:38:16) Closing Remarks on AI Policy Challenges

(01:39:51) Outro

Nathan presents a comprehensive AI automation framework developed over three years, applicable to process automation and generative AI integration. This episode of The Cognitive Revolution, offers critical insights for businesses looking to leverage AI effectively. Learn about choosing AI tasks, understanding work deeply, and optimizing AI performance in the wake of GPT-4 fine-tuning launch.

Slide Deck

Waymark's case study on GPT-3 fine-tuning

Apply to join over 400 founders and execs in the Turpentine Network

1 to 100 | Hypergrowth Companies Worth Joining

Every week we sit down with the founder of a hyper-growth company you should consider joining. Our goal is to give you the inside story behind breakout, early stage companies potentially worth betting your career on. This season, discover how the founders of Modal Labs, Clay, Mercor, and more built their products, cultures, and companies.

Apple: https://podcasts.apple.com/podcast/id1762756034

Spotify:https://open.spotify.com/show/70NOWtWDY995C8qDqojxGw

History 102

Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour.

Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm

Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913

YouTube: https://www.youtube.com/@History102-qg5oj

Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/speak to accelerate your career and contribute to solving pressing AI-related issues.

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsor: WorkOS

(00:01:22) About the Episode

(00:04:20) Introduction to AI Automation

(00:13:43) Current AI Capabilities

(00:17:24) Sponsors: Oracle | Brave

(00:19:28) 3 Ways to work with AI

(00:25:10) Choosing Work for AI to Do

(00:31:18) Sponsors: Omneky | 80000 hours

(00:33:20) What AI Can Do vs. Can't Do

(00:47:11) Understanding the Work

(00:52:58) Documenting the Work

(01:00:50) Optimising AI Performance

(01:02:14) Prompt Engineering Gold Standards

(01:07:05) Optimising Information: Retrieval Augmented Generation

(01:09:29) Optimising AI Behaviour: Fine-tuning AI Models

(01:50:38) Outro

Nathan explores the cutting-edge field of mechanistic interpretability with Dan Balsam and Tom McGrath, co-founders of Goodfire. In this episode of The Cognitive Revolution, we delve into the science of understanding AI models' inner workings, recent breakthroughs, and the potential impact on AI safety and control. Join us for an insightful discussion on sparse autoencoders, polysemanticity, and the future of interpretable AI.

Papers

Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

(00:00:00) About the Show

(00:00:22) About the Episode

(00:03:52) Introduction and Background

(00:08:43) State of Interpretability Research

(00:12:06) Key Insights in Interpretability

(00:16:53) Polysemanticity and Model Compression (Part 1)

(00:17:00) Sponsors: Oracle | Brave

(00:19:04) Polysemanticity and Model Compression (Part 2)

(00:22:50) Sparse Autoencoders Explained

(00:27:19) Challenges in Interpretability Research (Part 1)

(00:30:54) Sponsors: Omneky | Squad

(00:32:41) Challenges in Interpretability Research (Part 2)

(00:33:51) Goodfire's Vision and Mission

(00:37:08) Interpretability and Scientific Models

(00:43:48) Architecture and Interpretability Techniques

(00:50:08) Quantization and Model Representation

(00:54:07) Future of Interpretability Research

(01:01:38) Skepticism and Challenges in Interpretability

(01:07:51) Alternative Architectures and Universality

(01:13:39) Goodfire's Business Model and Funding

(01:18:47) Building the Team and Future Plans

(01:31:03) Hiring and Getting Involved in Interpretability

(01:51:28) Closing Remarks

(01:51:38) Outro