this IS research

If it feels like a shortcut, it’s probably a shortcut.


Listen Later

Is it okay to use large language models in the research process? For what task, exactly, and to automate the task or to augment the researcher? In this episode, we try to explore whether and how LLMs could be used in five aspects of the research process - for paper writing, reviewing, data analysis, as a subject of research, or as a surrogate for research subjects. We also discuss whether they should be used at all, and what some long-term consequences could be of such a choice, and we develop a number of heuristic rules to help researcher make decisions about using LLMs for research. Episode reading list Kankanhalli, A. (2024). Peer Review in the Age of Generative AI. Journal of the Association for Information Systems, 25(1), 76-84. Yang, Y., Duan, H., Liu, J., & Tam, K. Y. (2024). LLM-Measure: Generating Valid, Consistent, and Reproducible Text-Based Measures for Social Science Research. arXiv preprint, . Li, J., Larsen, K. R. T., & Abbasi, A. (2020). TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning. MIS Quarterly, 44(4), 1733-1772. Larsen, K. R., Yan, S., & Lukyanenko, R. (2024). LLMs and Psychometrics: Global Construct Validity Integrating LLMs and Psychometrics. 45th International Conference on Information Systems, Bangkok, Thailand. Anthis, J. R., Liu, R., Richardson, S. M., Kozlowski, A. C., Koch, B., Evans, J., Brynjolfsson, E., & Bernstein, M. (2025). LLM Social Simulations Are a Promising Research Method. arXiv preprint, . Abbasi, A., Somanchi, S., & Kelley, K. (2025). The Critical Challenge of using Large-scale Digital Experiment Platforms for Scientific Discovery. MIS Quarterly, 49(1), 1-28.
...more
View all episodesView all episodes
Download on the App Store

this IS researchBy Nick Berente and Jan Recker

  • 5
  • 5
  • 5
  • 5
  • 5

5

15 ratings


More shows like this IS research

View all
tagesschau (Audio-Podcast) by tagesschau

tagesschau (Audio-Podcast)

118 Listeners

Philosophize This! by Stephen West

Philosophize This!

15,093 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,469 Listeners

OMR Podcast by Philipp Westermeyer - OMR

OMR Podcast

41 Listeners

The Gray Area with Sean Illing by Vox

The Gray Area with Sean Illing

10,700 Listeners

Lage der Nation - der Politik-Podcast aus Berlin by Philip Banse & Ulf Buermeyer

Lage der Nation - der Politik-Podcast aus Berlin

242 Listeners

Der Politikpodcast by Deutschlandfunk

Der Politikpodcast

38 Listeners

Against the Rules with Michael Lewis by Pushkin Industries

Against the Rules with Michael Lewis

9,519 Listeners

Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

Your Undivided Attention

1,472 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,291 Listeners

Doppelgänger Tech Talk by Philipp Glöckler, Philipp Klöckner

Doppelgänger Tech Talk

11 Listeners

Me, Myself, and AI by MIT Sloan Management Review and Boston Consulting Group (BCG)

Me, Myself, and AI

106 Listeners

Information Systems DIGEST Podcast by NTNU - Digital Enterprise

Information Systems DIGEST Podcast

2 Listeners

LANZ & PRECHT by ZDF, Markus Lanz & Richard David Precht

LANZ & PRECHT

307 Listeners

Die Peter Thiel Story by Deutschlandfunk

Die Peter Thiel Story

68 Listeners