Using LLMs can seem like a safe bet - but they have biases built in at every stage of the process. In this episode, we'll talk about how bias sneaks in and look at some studies that detail how LLMs are trained and how to watch out for and correct bias in an educational context.

Notes:

Follow up on the Tutor CoPilot study from the first week: https://lukeshepard.com/blog/preregistration-of-outcomes

Reserach about LLMs in classrooms: LLMs Are Biased Teachers

Meta's study on A Systematic Study of Bias Amplification

OpenAI discusses their own dataset: OpenAI: Is ChatGPT Biased?

I was influenced by Dr. Timnit Gebru- on AI Bias and the recently published The AI Con Book, which goes into more detail about how bias works in LLMs and the risks across industries.