this IS research

If it feels like a shortcut, it’s probably a shortcut.


Listen Later

Is it okay to use large language models in the research process? For what task, exactly, and to automate the task or to augment the researcher? In this episode, we try to explore whether and how LLMs could be used in five aspects of the research process - for paper writing, reviewing, data analysis, as a subject of research, or as a surrogate for research subjects. We also discuss whether they should be used at all, and what some long-term consequences could be of such a choice, and we develop a number of heuristic rules to help researcher make decisions about using LLMs for research. Episode reading list Kankanhalli, A. (2024). Peer Review in the Age of Generative AI. Journal of the Association for Information Systems, 25(1), 76-84. Yang, Y., Duan, H., Liu, J., & Tam, K. Y. (2024). LLM-Measure: Generating Valid, Consistent, and Reproducible Text-Based Measures for Social Science Research. arXiv preprint, . Li, J., Larsen, K. R. T., & Abbasi, A. (2020). TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning. MIS Quarterly, 44(4), 1733-1772. Larsen, K. R., Yan, S., & Lukyanenko, R. (2024). LLMs and Psychometrics: Global Construct Validity Integrating LLMs and Psychometrics. 45th International Conference on Information Systems, Bangkok, Thailand. Anthis, J. R., Liu, R., Richardson, S. M., Kozlowski, A. C., Koch, B., Evans, J., Brynjolfsson, E., & Bernstein, M. (2025). LLM Social Simulations Are a Promising Research Method. arXiv preprint, . Abbasi, A., Somanchi, S., & Kelley, K. (2025). The Critical Challenge of using Large-scale Digital Experiment Platforms for Scientific Discovery. MIS Quarterly, 49(1), 1-28.
...more
View all episodesView all episodes
Download on the App Store

this IS researchBy Nick Berente and Jan Recker

  • 5
  • 5
  • 5
  • 5
  • 5

5

15 ratings


More shows like this IS research

View all
tagesschau (Audio-Podcast) by tagesschau

tagesschau (Audio-Podcast)

115 Listeners

Philosophize This! by Stephen West

Philosophize This!

15,106 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,366 Listeners

OMR Podcast by Philipp Westermeyer - OMR

OMR Podcast

35 Listeners

The Gray Area with Sean Illing by Vox

The Gray Area with Sean Illing

10,667 Listeners

Lage der Nation - der Politik-Podcast aus Berlin by Philip Banse & Ulf Buermeyer

Lage der Nation - der Politik-Podcast aus Berlin

231 Listeners

Der Politikpodcast by Deutschlandfunk

Der Politikpodcast

39 Listeners

Against the Rules with Michael Lewis by Pushkin Industries

Against the Rules with Michael Lewis

9,527 Listeners

Your Undivided Attention by The Center for Humane Technology, Tristan Harris, Daniel Barcay and Aza Raskin

Your Undivided Attention

1,529 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,299 Listeners

Doppelgänger Tech Talk by Philipp Glöckler, Philipp Klöckner

Doppelgänger Tech Talk

10 Listeners

Me, Myself, and AI by MIT Sloan Management Review

Me, Myself, and AI

107 Listeners

Information Systems DIGEST Podcast by NTNU - Digital Enterprise

Information Systems DIGEST Podcast

1 Listeners

LANZ & PRECHT by ZDF, Markus Lanz & Richard David Precht

LANZ & PRECHT

290 Listeners

Die Peter Thiel Story by Deutschlandfunk

Die Peter Thiel Story

43 Listeners