Lucius Caviola is an Assistant Professor in the Social Science of AI at the University of Cambridge's Leverhulme Centre for the Future of Intelligence, and a Research Associate in Psychology at Harvard University. His research explores how the potential arrival of conscious AI will reshape our social and moral norms. In today's interview, Lucius examines the psychological and social factors that will determine whether this transition unfolds well, or ends in moral catastrophe. He discusses:

• Why experts estimate a 50% chance that conscious digital minds will emerge by 2050
• The "takeoff" scenario where digital minds could outnumber humans in welfare capacity within a decade
• How "biological chauvinism" leads people to deny consciousness even in perfect whole-brain emulations
• The dual risks of "under-attribution" (unwittingly creating mass suffering) and "over-attribution" (sacrificing human values for unfeeling code)
• Surprising findings that people refuse to "harm" AI in economic games even when they explicitly believe the AI isn't conscious

Lucius argues that rigorous social science and forecasting are essential tools for navigating these risks, moving beyond intuition to prevent us from accidentally creating vast populations of digital beings capable of suffering, or failing to recognise consciousness where it exists.