this IS research

If it feels like a shortcut, it’s probably a shortcut.


Listen Later

Is it okay to use large language models in the research process? For what task, exactly, and to automate the task or to augment the researcher? In this episode, we try to explore whether and how LLMs could be used in five aspects of the research process - for paper writing, reviewing, data analysis, as a subject of research, or as a surrogate for research subjects. We also discuss whether they should be used at all, and what some long-term consequences could be of such a choice, and we develop a number of heuristic rules to help researcher make decisions about using LLMs for research. Episode reading list Kankanhalli, A. (2024). Peer Review in the Age of Generative AI. Journal of the Association for Information Systems, 25(1), 76-84. Yang, Y., Duan, H., Liu, J., & Tam, K. Y. (2024). LLM-Measure: Generating Valid, Consistent, and Reproducible Text-Based Measures for Social Science Research. arXiv preprint, . Li, J., Larsen, K. R. T., & Abbasi, A. (2020). TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning. MIS Quarterly, 44(4), 1733-1772. Larsen, K. R., Yan, S., & Lukyanenko, R. (2024). LLMs and Psychometrics: Global Construct Validity Integrating LLMs and Psychometrics. 45th International Conference on Information Systems, Bangkok, Thailand. Anthis, J. R., Liu, R., Richardson, S. M., Kozlowski, A. C., Koch, B., Evans, J., Brynjolfsson, E., & Bernstein, M. (2025). LLM Social Simulations Are a Promising Research Method. arXiv preprint, . Abbasi, A., Somanchi, S., & Kelley, K. (2025). The Critical Challenge of using Large-scale Digital Experiment Platforms for Scientific Discovery. MIS Quarterly, 49(1), 1-28.
...more
View all episodesView all episodes
Download on the App Store

this IS researchBy Nick Berente and Jan Recker

  • 5
  • 5
  • 5
  • 5
  • 5

5

13 ratings


More shows like this IS research

View all
Planet Money by NPR

Planet Money

30,823 Listeners

World Business Report by BBC World Service

World Business Report

285 Listeners

Freakonomics Radio by Freakonomics Radio + Stitcher

Freakonomics Radio

32,260 Listeners

Goldman Sachs Exchanges by Goldman Sachs

Goldman Sachs Exchanges

991 Listeners

Pivot by New York Magazine

Pivot

9,140 Listeners

FT News Briefing by Financial Times

FT News Briefing

686 Listeners

Handelsblatt Disrupt - Der Podcast über die Zukunft der Wirtschaft by Sebastian Matthes, Handelsblatt

Handelsblatt Disrupt - Der Podcast über die Zukunft der Wirtschaft

15 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,312 Listeners

No Stupid Questions by Freakonomics Radio + Stitcher

No Stupid Questions

3,678 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,285 Listeners

People I (Mostly) Admire by Freakonomics Radio + Stitcher

People I (Mostly) Admire

2,136 Listeners

Hard Fork by The New York Times

Hard Fork

5,438 Listeners

Information Systems DIGEST Podcast by NTNU - Digital Enterprise

Information Systems DIGEST Podcast

2 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,220 Listeners

What Now? with Trevor Noah by Trevor Noah

What Now? with Trevor Noah

4,059 Listeners