No Putting the Genie Back in the Bottle: The New Problems Introduced by AI Writing Tools
Dr. Aure Schrock
Transcript: Hello and welcome back to Academic Writing Talk. My name is still Dr. Aure Schrock and I'm here to help demystify academic writing and publishing for you. If you're an academic writer, no matter if you just started a PhD program or are a seasoned professor, this podcast is for you. At my company, Indelible Voice, I've been trying to wrap my head around where AI writing tools are taking us. And as far as I can tell, nobody has really cracked the code here. It's a total mess. We have professional organizations struggling with peer review and the way AI writing tools are used to review submissions. We have authors who are, I think, justifiably curious about improving their workflow and teachers, whether they're teaching writing composition or another topic, trying to figure out how to teach writing with these new tools that have really been kind of thrust into our world over the last two or three years without a real plan of how they're going to be pedagogically useful. And that's one of the real challenges, right? These tools are just out there. They're in the hands of young writers, and they've really been naturalized to turning to them when they encounter writing problems.
I figured this out a few years ago when, as a writing coach, I was talking with a graduate student client, and I think at the time I assumed that he would use AI writing tools like ChatGPT to essentially produce writing. And I was surprised to hear that he actually used it to motivate him to respond to questions about the writing process. In other words, he was treating AI writing tools essentially as a kind of writing coach, right? So that's one big adjustment in our thinking, right? It's not just that there's an agentic tool, say within Microsoft Word, that can offer spelling and grammar corrections. A lot of these tools are essentially so agentic they are treated by authors as what they are: agents. The other way I think these tools force us to adjust our thinking about writing is that they essentially invert the way that we tend to think about writing literacies. By "invert" I mean that typically when you are learning how to write, you start with the writing fundamentals, right? This is where hooked-on phonics came from. You can sound out unfamiliar words, for example. And you have some grasp of how the words on the page should be arranged. On top of that, you build disciplinary knowledge, and this happens in undergraduate and graduate programs. For example, if you're a graduate student in sociology, you learn how a sociologist will approach a particular problem or seek to understand more about it.
That disciplinary knowledge is built on reading literacies and writing literacies because you have to read books, you have to read articles to understand how sociology works and what sociological research means, how it's done. And only by the end of your PhD program are you really doing high-level synthesis. In other words, your dissertation is really where synthesis comes to the fore. You are designing a large research project, collecting data, and then writing up the results. Now, AI writing tools have inverted this, right? They start with the synthesis at a high level, but the big problem is that a lot of academic writers no longer really have the literacies on grammar and spelling level.
Or the disciplinary knowledge to evaluate what AI writing tools are essentially making claims about. So from my perspective as a writing coach, both of these developments, both people treating AI writing tools as essentially writing coaches and the more top-down perspective on how people learn and how people come to make high-level claims, that are relevant to their discipline has been utterly broken, right? And whether you're a fan of AI or not, as you might know from my writing and videos that I produce, I'm somewhat of a cautious adopter of new technologies. But regardless of if you're a fan of this stuff or not, you really have to accept that it is changing the lay of the land for academic writing. I don't think there's a putting the genie back in the bottle.
Note that I'm not saying that AI writing tools are perfect. I don't think that's the case. I think they have limitations. I think they have better or worse ways they can be used, and they shouldn't be used for absolutely every form of academic writing. And in fact, I think they are more useful as a writing coach kind of style agent than they are for actually producing text or doing that synthetic thinking. You might use the synthetic thinking as a way to kind of, if we're thinking about inverting that pyramid of learning with on the bottom, you have literacies, disciplinary knowledge, and then only synthesis at the top. If AI writing tools kind of invert that and you start at synthesis, I do think graduate students and undergrads need to be able to work down from that point, right? So that they do attain the level of literacy necessary and the disciplinary knowledge that a rigorous program should impart to their students. And from the perspective of teachers, which I'm familiar with, I taught part-time on and off in higher education for some 15 years everywhere from big state schools like University of Central Florida to private institutions like USC where I got my PhD.
From that perspective, as an instructor or professor, I still think we're kind of in the Wild West, and things are going to be a little bit frustrating, I think, until they settle down. Right now, we don't really know what works. We don't know how these tools help or hurt academic writers. And a lot of the evidence that I see actually speaks to some serious problems with their use if they're used in a totally unconstrained way. Because, you know, I was an undergrad once too. It's not surprising to me that undergrads look at say, chat GPT and say, wow, it's a magic box that spits out answers to questions my professor is posing me. It's totally not surprising to me that these tools have an allure. I think we do need to figure out some middle ground between completely rejecting them and just blithely accepting them. Because our students are coming to college or university to learn, and I'm pretty sure what they expect to learn is not just how to input the correct prompts into cloud or chat GPT, right? They are hungry for knowledge, and to attain that, it’s just on a day-to-day level, the encroachment of these tools really tends to work against their otherwise well-meaning impulses.
If I sound somewhat optimistic, I am. I tend to be an optimist, as it's my personality. And I do think over the next couple years, we'll start to see a somewhat more settled environment. We'll start to see standard ways that AI writing tools can be incorporated into PhD level projects like dissertation writing. I'm really interested in this idea just because to structure that bigger writing project has always been a big challenge for students and sometimes the sheer size of it is a challenge to keep track of. And then I think on a more undergraduate level, so far as writing composition and just general writing practices, I do think you're going to see more research coming out that says, well, if you use AI writing tools in this way, they're going to work against you. They're going to inhibit learning. But if you use it this way, maybe it actually helps you be more critical. These are, I think, some of what I am just calling the new writing problems that AI imposes on us. And if this topic interests you, subscribe to my newsletter. Go to indeliblevoice.com slash newsletter. All of my content will be announced there. And I don't send newsletters very often. We're talking like, I don't know, twice a month at most.
Thanks so much for listening. I hope you've enjoyed hearing me wax philosophical a little bit about the encroachment of AI writing tools. I don't think we're totally sunk, but I do think the next few years is going to be a little bit more chaotic than usual. If you have found yourself a little bit over your head, I am working on a workshop that I'm just calling the AI Hangover Cure. So if you found yourself in over your head with AI writing tools, you need to take a step back and figure out what's working, what's not. This is for you. Just go to indeliblevoice.com/workshops and sign up there. I'm still aiming to do that in the fall sometime before the new year. And as always, I'm still offering paid editing and writing coaching services. If you want to boost your academic writing with working with me, just go to indeliblevoice.com, click on contact, and I'd be happy to chat with you. Thanks so much. And until next episode, happy writing.