this IS research

Should all qualitative researchers use LLMs?


Listen Later

One of the big topics at the conference this summer was the use of large language models in the research process, especially in qualitative studies. We expand this discussion by asking: can qualitative research be automated—or augmented? Yes and no. Some of the advantages LLMs bring to the table are hard to ignore. LLMs can act as critical reviewers, as a consistency checker, as a provider of alternative perspectives on unstructured data, or to break path dependencies in the process of data analysis. They can also help find interesting outcomes that qualitative insights could explain. At the same time, the use of LLMs comes with thorny pitfalls. We know they are unreliable and hallucinate. And the output they create is… average at best. So if you use LLMs, make sure you are not using it for automation—do not lose touch with your craft or your data. Whatever tool you use, make sure you remain a virtuous scholar. Episode reading list Noblit, G. W., & Hare, R. D. (1988). Meta-Ethnography: Synthesising Qualitative Studies. Sage. Recker, J. (2021). Improving the State-Tracking Ability of Corona Dashboards. European Journal of Information Systems, 30(5), 476-495. Rynes, S., & Gephart Jr., R. P. (2004). Qualitative Research and the "Academy of Management Journal". Academy of Management Journal, 47(4), 454-462. Geertz, C. (1973). The Interpretation Of Cultures. Basic Books. Boland, R. J. (2001). The Tyranny of Space in Organizational Analysis. Information and Organization, 11(1), 3-23. Weber, R. (2004). Editor's Comments: The Rhetoric of Positivism Versus Interpretivism: A Personal View. MIS Quarterly, 28(1), iii-xii. Lehmann, J., Hukal, P., Recker, J., & Tumbas, S. (2025). Layering the Architecture of Digital Product Innovations: Firmware and Adapter Layers. Journal of the Association for Information Systems, 26, . Lindberg, A., Berente, N., Howison, J., & Lyytinen, K. (2024). Discursive Modulation in Open Source Software: How Communities Shape Novelty and Complexity. MIS Quarterly, 48(4), 1395-1422. Ragin, C. C. (1987). The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. University of California Press. Goodhue, D. L., Lewis, W., & Thompson, R. L. (2012). Comparing PLS to Regression and LISREL: A Response to Marcoulides, Chin, and Saunders. MIS Quarterly, 36(3), 703-716. Goodhue, D. L., Lewis, W., & Thompson, R. L. (2007). Statistical Power in Analyzing Interaction Effects: Questioning the Advantage of PLS With Product Indicators. Information Systems Research, 18(2), 211-227.
...more
View all episodesView all episodes
Download on the App Store

this IS researchBy Nick Berente and Jan Recker

  • 5
  • 5
  • 5
  • 5
  • 5

5

18 ratings


More shows like this IS research

View all
Odd Lots by Bloomberg

Odd Lots

1,865 Listeners

Newscast by BBC News

Newscast

650 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,448 Listeners

Capitalisn't by University of Chicago Podcast Network

Capitalisn't

540 Listeners

De Jortcast by NPO Radio 1 / AVROTROS

De Jortcast

89 Listeners

The Prof G Pod with Scott Galloway by Vox Media Podcast Network

The Prof G Pod with Scott Galloway

5,467 Listeners

All-In with Chamath, Jason, Sacks  Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks Friedberg

9,833 Listeners

Deep Questions with Cal Newport by Cal Newport

Deep Questions with Cal Newport

1,306 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

489 Listeners

Hard Fork by The New York Times

Hard Fork

5,470 Listeners

Huberman Lab by Scicomm Media

Huberman Lab

29,146 Listeners

Ones and Tooze by Foreign  Policy

Ones and Tooze

348 Listeners

The Rest Is Politics by Goalhanger

The Rest Is Politics

3,115 Listeners

The Rest Is Politics: Leading by Goalhanger

The Rest Is Politics: Leading

858 Listeners

The Global Story by BBC World Service

The Global Story

252 Listeners