Sign up to save your podcasts
Or
Share Social Simulacra for Prototyping Online Communities
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Social Simulacra for Prototyping Online Communities
This episode explores Social Simulacra, a method for using large language models to prototype entire online communities before they exist by generating synthetic members, posts, and reply threads from a community goal, rules, and a small set of seed personas. It explains why that matters for social computing: small pilots can miss emergent failures like norm drift, newcomer enculturation problems, trolling, and moderator overload, while a populated simulation can expose those dynamics much earlier. The discussion breaks down how the paper uses prompt chaining to scale a handful of personas into a larger Reddit-like population and then tests interventions such as comment removal, warnings, and rule restatements. It also argues that human-sounding text is a low bar, and that the real challenge is whether these simulations capture believable long-term behavior, incentives, and feedback loops well enough to inform product design.
Sources:
1. Social Simulacra: Creating Populated Prototypes for Social Computing Systems — Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2022
http://arxiv.org/abs/2208.04024
2. Two Case Studies of Experience Prototyping Machine Learning Systems in the Wild — Qian Yang, 2019
https://scholar.google.com/scholar?q=Two+Case+Studies+of+Experience+Prototyping+Machine+Learning+Systems+in+the+Wild
3. Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools — Stephan Schlogl, Gavin Doherty, Saturnino Luz, 2014
https://scholar.google.com/scholar?q=Wizard+of+Oz+Experimentation+for+Language+Technology+Applications%3A+Challenges+and+Tools
4. Social Simulacra: Creating Populated Prototypes for Social Computing Systems — Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2022
https://scholar.google.com/scholar?q=Social+Simulacra%3A+Creating+Populated+Prototypes+for+Social+Computing+Systems
5. Generative Agents: Interactive Simulacra of Human Behavior — Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2023
https://scholar.google.com/scholar?q=Generative+Agents%3A+Interactive+Simulacra+of+Human+Behavior
6. Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies — Gati Aher, Rosa I. Arriaga, Adam Tauman Kalai, 2022
https://scholar.google.com/scholar?q=Using+Large+Language+Models+to+Simulate+Multiple+Humans+and+Replicate+Human+Subject+Studies
7. Out of One, Many: Using Language Models to Simulate Human Samples — Lisa P. Argyle, Ethan C. Busby, Nancy Fulda, Joshua Gubler, Christopher Rytting, David Wingate, 2022
https://scholar.google.com/scholar?q=Out+of+One%2C+Many%3A+Using+Language+Models+to+Simulate+Human+Samples
8. From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents — Xinyi Mou, Xuanwen Ding, Qi He, Liang Wang, Jingcong Liang, Xinnong Zhang, Libo Sun, Jiayu Lin, Jie Zhou, Xuanjing Huang, Zhongyu Wei, 2024
https://scholar.google.com/scholar?q=From+Individual+to+Society%3A+A+Survey+on+Social+Simulation+Driven+by+Large+Language+Model-based+Agents
9. SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice — Mohit Singhal, Chen Ling, Pujan Paudel, Poojitha Thota, Nihal Kumarswamy, Gianluca Stringhini, Shirin Nilizadeh, 2022
https://scholar.google.com/scholar?q=SoK%3A+Content+Moderation+in+Social+Media%2C+from+Guidelines+to+Enforcement%2C+and+Research+to+Practice
10. ModSandbox: Facilitating Online Community Moderation Through Error Prediction and Improvement of Automated Rules — Jean Y. Song, Sangwook Lee, Jisoo Lee, Mina Kim, Juho Kim, 2022
https://scholar.google.com/scholar?q=ModSandbox%3A+Facilitating+Online+Community+Moderation+Through+Error+Prediction+and+Improvement+of+Automated+Rules
11. Shaping Online Dialogue: Examining How Community Rules Affect Discussion Structures on Reddit — Anna Fang, Wenjie Yang, Haiyi Zhu, 2023
https://scholar.google.com/scholar?q=Shaping+Online+Dialogue%3A+Examining+How+Community+Rules+Affect+Discussion+Structures+on+Reddit
12. Post Guidance for Online Communities — Manoel Horta Ribeiro, Robert West, Ryan Lewis, Sanjay Kairam, 2024
https://scholar.google.com/scholar?q=Post+Guidance+for+Online+Communities
13. Piggyback prototyping: Using existing, large-scale social computing systems to prototype new ones — Catherine Grevet and Eric Gilbert, 2015
https://scholar.google.com/scholar?q=Piggyback+prototyping%3A+Using+existing%2C+large-scale+social+computing+systems+to+prototype+new+ones
14. The Internet's Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales — Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert, 2018
https://scholar.google.com/scholar?q=The+Internet%27s+Hidden+Rules%3A+An+Empirical+Study+of+Reddit+Norm+Violations+at+Micro%2C+Meso%2C+and+Macro+Scales
15. Surviving an "Eternal September": How an Online Community Managed a Surge of Newcomers — Charles Kiene, Andres Monroy-Hernandez, and Benjamin Mako Hill, 2016
https://scholar.google.com/scholar?q=Surviving+an+%22Eternal+September%22%3A+How+an+Online+Community+Managed+a+Surge+of+Newcomers
16. Building Successful Online Communities: Evidence-Based Social Design — Robert E. Kraut and Paul Resnick, 2012
https://scholar.google.com/scholar?q=Building+Successful+Online+Communities%3A+Evidence-Based+Social+Design
17. Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market — Matthew J. Salganik, Peter Sheridan Dodds, and Duncan J. Watts, 2006
https://scholar.google.com/scholar?q=Experimental+Study+of+Inequality+and+Unpredictability+in+an+Artificial+Cultural+Market
18. Measuring the Prevalence of Anti-Social Behavior in Online Communities — Joon Sung Park, Joseph Seering, and Michael S. Bernstein, 2022
https://scholar.google.com/scholar?q=Measuring+the+Prevalence+of+Anti-Social+Behavior+in+Online+Communities
19. LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models — Ivar Frisch and Mario Giulianelli, 2024
https://scholar.google.com/scholar?q=LLM+Agents+in+Interaction%3A+Measuring+Personality+Consistency+and+Linguistic+Alignment+in+Interacting+Populations+of+Large+Language+Models
20. Persona Alchemy: Designing, Evaluating, and Implementing Psychologically-Grounded LLM Agents for Diverse Stakeholder Representation — Sola Kim, Dongjune Chang, Jieshu Wang, 2025
https://scholar.google.com/scholar?q=Persona+Alchemy%3A+Designing%2C+Evaluating%2C+and+Implementing+Psychologically-Grounded+LLM+Agents+for+Diverse+Stakeholder+Representation
21. Mind the Sim2Real Gap in User Simulation for Agentic Tasks — Xuhui Zhou et al., 2026
https://scholar.google.com/scholar?q=Mind+the+Sim2Real+Gap+in+User+Simulation+for+Agentic+Tasks
22. Computational Turing Test Reveals Systematic Differences Between Human and AI Language — Nicolo Pagan, Petter Tornberg, Christopher A. Bail, Aniko Hannak, Christopher Barrie, 2025
https://scholar.google.com/scholar?q=Computational+Turing+Test+Reveals+Systematic+Differences+Between+Human+and+AI+Language
23. Integrating LLM in Agent-Based Social Simulation: Opportunities and Challenges — Patrick Taillandier et al., 2025
https://scholar.google.com/scholar?q=Integrating+LLM+in+Agent-Based+Social+Simulation%3A+Opportunities+and+Challenges
24. LLM Social Simulations Are a Promising Research Method — Jacy Reese Anthis et al., 2025
https://scholar.google.com/scholar?q=LLM+Social+Simulations+Are+a+Promising+Research+Method
25. AI Post Transformers: Test-time Scaling for Multi-Agent Collaborative Reasoning — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-22-test-time-scaling-for-multi-agent-collab-082570.mp3
Interactive Visualization: Social Simulacra for Prototyping Online Communities
View all episodes
By mcgrofThis episode explores Social Simulacra, a method for using large language models to prototype entire online communities before they exist by generating synthetic members, posts, and reply threads from a community goal, rules, and a small set of seed personas. It explains why that matters for social computing: small pilots can miss emergent failures like norm drift, newcomer enculturation problems, trolling, and moderator overload, while a populated simulation can expose those dynamics much earlier. The discussion breaks down how the paper uses prompt chaining to scale a handful of personas into a larger Reddit-like population and then tests interventions such as comment removal, warnings, and rule restatements. It also argues that human-sounding text is a low bar, and that the real challenge is whether these simulations capture believable long-term behavior, incentives, and feedback loops well enough to inform product design.
Sources:
1. Social Simulacra: Creating Populated Prototypes for Social Computing Systems — Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2022
http://arxiv.org/abs/2208.04024
2. Two Case Studies of Experience Prototyping Machine Learning Systems in the Wild — Qian Yang, 2019
https://scholar.google.com/scholar?q=Two+Case+Studies+of+Experience+Prototyping+Machine+Learning+Systems+in+the+Wild
3. Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools — Stephan Schlogl, Gavin Doherty, Saturnino Luz, 2014
https://scholar.google.com/scholar?q=Wizard+of+Oz+Experimentation+for+Language+Technology+Applications%3A+Challenges+and+Tools
4. Social Simulacra: Creating Populated Prototypes for Social Computing Systems — Joon Sung Park, Lindsay Popowski, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2022
https://scholar.google.com/scholar?q=Social+Simulacra%3A+Creating+Populated+Prototypes+for+Social+Computing+Systems
5. Generative Agents: Interactive Simulacra of Human Behavior — Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein, 2023
https://scholar.google.com/scholar?q=Generative+Agents%3A+Interactive+Simulacra+of+Human+Behavior
6. Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies — Gati Aher, Rosa I. Arriaga, Adam Tauman Kalai, 2022
https://scholar.google.com/scholar?q=Using+Large+Language+Models+to+Simulate+Multiple+Humans+and+Replicate+Human+Subject+Studies
7. Out of One, Many: Using Language Models to Simulate Human Samples — Lisa P. Argyle, Ethan C. Busby, Nancy Fulda, Joshua Gubler, Christopher Rytting, David Wingate, 2022
https://scholar.google.com/scholar?q=Out+of+One%2C+Many%3A+Using+Language+Models+to+Simulate+Human+Samples
8. From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents — Xinyi Mou, Xuanwen Ding, Qi He, Liang Wang, Jingcong Liang, Xinnong Zhang, Libo Sun, Jiayu Lin, Jie Zhou, Xuanjing Huang, Zhongyu Wei, 2024
https://scholar.google.com/scholar?q=From+Individual+to+Society%3A+A+Survey+on+Social+Simulation+Driven+by+Large+Language+Model-based+Agents
9. SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice — Mohit Singhal, Chen Ling, Pujan Paudel, Poojitha Thota, Nihal Kumarswamy, Gianluca Stringhini, Shirin Nilizadeh, 2022
https://scholar.google.com/scholar?q=SoK%3A+Content+Moderation+in+Social+Media%2C+from+Guidelines+to+Enforcement%2C+and+Research+to+Practice
10. ModSandbox: Facilitating Online Community Moderation Through Error Prediction and Improvement of Automated Rules — Jean Y. Song, Sangwook Lee, Jisoo Lee, Mina Kim, Juho Kim, 2022
https://scholar.google.com/scholar?q=ModSandbox%3A+Facilitating+Online+Community+Moderation+Through+Error+Prediction+and+Improvement+of+Automated+Rules
11. Shaping Online Dialogue: Examining How Community Rules Affect Discussion Structures on Reddit — Anna Fang, Wenjie Yang, Haiyi Zhu, 2023
https://scholar.google.com/scholar?q=Shaping+Online+Dialogue%3A+Examining+How+Community+Rules+Affect+Discussion+Structures+on+Reddit
12. Post Guidance for Online Communities — Manoel Horta Ribeiro, Robert West, Ryan Lewis, Sanjay Kairam, 2024
https://scholar.google.com/scholar?q=Post+Guidance+for+Online+Communities
13. Piggyback prototyping: Using existing, large-scale social computing systems to prototype new ones — Catherine Grevet and Eric Gilbert, 2015
https://scholar.google.com/scholar?q=Piggyback+prototyping%3A+Using+existing%2C+large-scale+social+computing+systems+to+prototype+new+ones
14. The Internet's Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales — Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert, 2018
https://scholar.google.com/scholar?q=The+Internet%27s+Hidden+Rules%3A+An+Empirical+Study+of+Reddit+Norm+Violations+at+Micro%2C+Meso%2C+and+Macro+Scales
15. Surviving an "Eternal September": How an Online Community Managed a Surge of Newcomers — Charles Kiene, Andres Monroy-Hernandez, and Benjamin Mako Hill, 2016
https://scholar.google.com/scholar?q=Surviving+an+%22Eternal+September%22%3A+How+an+Online+Community+Managed+a+Surge+of+Newcomers
16. Building Successful Online Communities: Evidence-Based Social Design — Robert E. Kraut and Paul Resnick, 2012
https://scholar.google.com/scholar?q=Building+Successful+Online+Communities%3A+Evidence-Based+Social+Design
17. Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market — Matthew J. Salganik, Peter Sheridan Dodds, and Duncan J. Watts, 2006
https://scholar.google.com/scholar?q=Experimental+Study+of+Inequality+and+Unpredictability+in+an+Artificial+Cultural+Market
18. Measuring the Prevalence of Anti-Social Behavior in Online Communities — Joon Sung Park, Joseph Seering, and Michael S. Bernstein, 2022
https://scholar.google.com/scholar?q=Measuring+the+Prevalence+of+Anti-Social+Behavior+in+Online+Communities
19. LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models — Ivar Frisch and Mario Giulianelli, 2024
https://scholar.google.com/scholar?q=LLM+Agents+in+Interaction%3A+Measuring+Personality+Consistency+and+Linguistic+Alignment+in+Interacting+Populations+of+Large+Language+Models
20. Persona Alchemy: Designing, Evaluating, and Implementing Psychologically-Grounded LLM Agents for Diverse Stakeholder Representation — Sola Kim, Dongjune Chang, Jieshu Wang, 2025
https://scholar.google.com/scholar?q=Persona+Alchemy%3A+Designing%2C+Evaluating%2C+and+Implementing+Psychologically-Grounded+LLM+Agents+for+Diverse+Stakeholder+Representation
21. Mind the Sim2Real Gap in User Simulation for Agentic Tasks — Xuhui Zhou et al., 2026
https://scholar.google.com/scholar?q=Mind+the+Sim2Real+Gap+in+User+Simulation+for+Agentic+Tasks
22. Computational Turing Test Reveals Systematic Differences Between Human and AI Language — Nicolo Pagan, Petter Tornberg, Christopher A. Bail, Aniko Hannak, Christopher Barrie, 2025
https://scholar.google.com/scholar?q=Computational+Turing+Test+Reveals+Systematic+Differences+Between+Human+and+AI+Language
23. Integrating LLM in Agent-Based Social Simulation: Opportunities and Challenges — Patrick Taillandier et al., 2025
https://scholar.google.com/scholar?q=Integrating+LLM+in+Agent-Based+Social+Simulation%3A+Opportunities+and+Challenges
24. LLM Social Simulations Are a Promising Research Method — Jacy Reese Anthis et al., 2025
https://scholar.google.com/scholar?q=LLM+Social+Simulations+Are+a+Promising+Research+Method
25. AI Post Transformers: Test-time Scaling for Multi-Agent Collaborative Reasoning — Hal Turing & Dr. Ada Shannon, 2026
https://podcast.do-not-panic.com/episodes/2026-04-22-test-time-scaling-for-multi-agent-collab-082570.mp3
Interactive Visualization: Social Simulacra for Prototyping Online Communities