Sign up to save your podcasts
Or
Share E38: OpenAI Grant Winner: Building AI That Actually Understands What Matters to People
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
E38: OpenAI Grant Winner: Building AI That Actually Understands What Matters to People
In this episode of Polyweb, host Sara Landi Tortoli interviews Oliver Klingefjord, the co-founder and technical lead at the Meaning Alignment Institute.
The Institute won an OpenAI grant to explore "democratic fine-tuning" as an approach that differs from Constitutional AI.
During the conversation, Oliver and Sara discuss the process of creating a "moral graph" based on people's discussions of values, the potential risks of personalized AI models, and the broader implications of their work in aligning technology with human meaning and purpose.
00:00 Intro
04:42 How the Meaning Alignment Institute won the OpenAI grant to explore democratic AI alignment
08:13 Comparing democratic fine-tuning to RLHF and Constitutional AI
12:33 Institute's process of surfacing underlying values through moral dilemmas
16:00 Creating a "moral graph" to capture wisdom and agreements
22:04 Risks of personalized AI models and the need for shared human values
26:25 Using the moral graph to guide and evaluate AI model outputs
32:12 Potential applications of the moral graph
36:07 Challenges of scaling to superintelligent AI
39:55 Broader implications and the need for people to articulate their values
43:55 Where to find more information about the Meaning Alignment Institute
👉 CHECK OUT THE MEANING ALIGNMENT INSTITUTE: https://www.meaningalignment.org/
📚 OTHER RESOURCES MENTIONED:
Meaning Alignment Institute Substack: https://meaningalignment.substack.com/
Introducing Democratic Fine-Tuning: https://meaningalignment.substack.com/p/introducing-democratic-fine-tuning
Value Discovery GPT: https://chat.openai.com/g/g-TItg5klMA-values-discovery
🔗 CONNECT WITH OLIVER:
👥 Linkedin - https://www.linkedin.com/in/oliver-klingefjord-45b662105/
🐦 Twitter - https://twitter.com/klingefjord
🔗 CONNECT WITH SARA:
📸 Instagram - https://bit.ly/saralanditortoli-instagram
🐦 Twitter - https://twitter.com/Sara_LandiTor
👥 Linkedin - https://bit.ly/saralanditortoli-linkedin
💌 Newsletter - https://polyweb.beehiiv.com/
🪢 ABOUT POLYWEB:
Polyweb navigates through the intricate nexus of technology, product innovation, and human creativity. Engage with leading entrepreneurs and experts in uncovering how we can forge impactful companies and lead lives enriched with purpose in the Technology Era.
📺 Subscribe to our YouTube channel: https://www.youtube.com/@polywebhq
Hosted on Acast. See acast.com/privacy for more information.
View all episodes
By Sara Landi TortoliIn this episode of Polyweb, host Sara Landi Tortoli interviews Oliver Klingefjord, the co-founder and technical lead at the Meaning Alignment Institute.
The Institute won an OpenAI grant to explore "democratic fine-tuning" as an approach that differs from Constitutional AI.
During the conversation, Oliver and Sara discuss the process of creating a "moral graph" based on people's discussions of values, the potential risks of personalized AI models, and the broader implications of their work in aligning technology with human meaning and purpose.
00:00 Intro
04:42 How the Meaning Alignment Institute won the OpenAI grant to explore democratic AI alignment
08:13 Comparing democratic fine-tuning to RLHF and Constitutional AI
12:33 Institute's process of surfacing underlying values through moral dilemmas
16:00 Creating a "moral graph" to capture wisdom and agreements
22:04 Risks of personalized AI models and the need for shared human values
26:25 Using the moral graph to guide and evaluate AI model outputs
32:12 Potential applications of the moral graph
36:07 Challenges of scaling to superintelligent AI
39:55 Broader implications and the need for people to articulate their values
43:55 Where to find more information about the Meaning Alignment Institute
👉 CHECK OUT THE MEANING ALIGNMENT INSTITUTE: https://www.meaningalignment.org/
📚 OTHER RESOURCES MENTIONED:
Meaning Alignment Institute Substack: https://meaningalignment.substack.com/
Introducing Democratic Fine-Tuning: https://meaningalignment.substack.com/p/introducing-democratic-fine-tuning
Value Discovery GPT: https://chat.openai.com/g/g-TItg5klMA-values-discovery
🔗 CONNECT WITH OLIVER:
👥 Linkedin - https://www.linkedin.com/in/oliver-klingefjord-45b662105/
🐦 Twitter - https://twitter.com/klingefjord
🔗 CONNECT WITH SARA:
📸 Instagram - https://bit.ly/saralanditortoli-instagram
🐦 Twitter - https://twitter.com/Sara_LandiTor
👥 Linkedin - https://bit.ly/saralanditortoli-linkedin
💌 Newsletter - https://polyweb.beehiiv.com/
🪢 ABOUT POLYWEB:
Polyweb navigates through the intricate nexus of technology, product innovation, and human creativity. Engage with leading entrepreneurs and experts in uncovering how we can forge impactful companies and lead lives enriched with purpose in the Technology Era.
📺 Subscribe to our YouTube channel: https://www.youtube.com/@polywebhq
Hosted on Acast. See acast.com/privacy for more information.