this IS research

If it feels like a shortcut, it's probably a shortcut.


Listen Later

Is it okay to use large language models in the research process? For what task, exactly, and to automate the task or to augment the researcher? In this episode, we try to explore whether and how LLMs could be used in five aspects of the research process - for paper writing, reviewing, data analysis, as a subject of research, or as a surrogate for research subjects. We also discuss whether they should be used at all, and what some long-term consequences could be of such a choice, and we develop a number of heuristic rules to help researcher make decisions about using LLMs for research. Episode reading list Kankanhalli, A. (2024). Peer Review in the Age of Generative AI. Journal of the Association for Information Systems, 25(1), 76-84. Yang, Y., Duan, H., Liu, J., & Tam, K. Y. (2024). LLM-Measure: Generating Valid, Consistent, and Reproducible Text-Based Measures for Social Science Research. arXiv preprint, https://arxiv.org/abs/2504.02234v1. Li, J., Larsen, K. R. T., & Abbasi, A. (2020). TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning. MIS Quarterly, 44(4), 1733-1772. Larsen, K. R., Yan, S., & Lukyanenko, R. (2024). LLMs and Psychometrics: Global Construct Validity Integrating LLMs and Psychometrics. 45th International Conference on Information Systems, Bangkok, Thailand. Anthis, J. R., Liu, R., Richardson, S. M., Kozlowski, A. C., Koch, B., Evans, J., Brynjolfsson, E., & Bernstein, M. (2025). LLM Social Simulations Are a Promising Research Method. arXiv preprint, https://arxiv.org/abs/2504.02234. Abbasi, A., Somanchi, S., & Kelley, K. (2025). The Critical Challenge of using Large-scale Digital Experiment Platforms for Scientific Discovery. MIS Quarterly, 49(1), 1-28.
...more
View all episodesView all episodes
Download on the App Store

this IS researchBy Nick Berente and Jan Recker

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

20 ratings


More shows like this IS research

View all
Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,196 Listeners

The Tim Ferriss Show by Tim Ferriss: Bestselling Author, Human Guinea Pig

The Tim Ferriss Show

16,183 Listeners

Pivot by New York Magazine

Pivot

9,558 Listeners

The Daily by The New York Times

The Daily

112,664 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,554 Listeners

Machtwechsel by Dagmar Rosenfeld und Robin Alexander

Machtwechsel

61 Listeners

LANZ & PRECHT by ZDF, Markus Lanz & Richard David Precht

LANZ & PRECHT

341 Listeners