How can recruiters keep up in an AI-driven hiring world where technical interviews face challenges like cheating using ChatGPT?

Aline Lerner, Founder & CEO of interviewing.io, and Michael Mroczka, Software Engineer and Dedicated Coaching Interviewer, explore the evolving world of recruiting and the surprising implications of AI tools like ChatGPT on technical hiring.

In this conversation with Shannon, Aline and Michael share insights from their groundbreaking study on cheating in interviews, the systemic flaws that encourage it, and why rethinking your interview questions is critical to safeguarding hiring integrity. They also share actionable strategies to create fair, efficient processes that work for both candidates and hiring managers.

Key Takeaways: 

1. Adapt interview processes: With tools like ChatGPT making it easier for candidates to cheat, traditional technical interview questions are becoming less effective. Shifting to customized, real-world problems gives you a more accurate assessment of skills and also reduces the ability of a candidate to misuse AI.
2. Prioritize fairness and transparency: Candidates often feel disenchanted by outdated or unfair processes. Thoughtful, well-designed interview questions not only improve hiring outcomes but also help build trust and create a better candidate experience.
3. Custom questions drive better hiring decisions: Verbatim questions from resources like LeetCode are more susceptible to AI-assisted cheating. Instead, tailor your questions to be rooted in actual work challenges so you get stronger signals about the candidate’s capabilities.

Timestamps: 

(00:00) Introduction

(01:03) Overview of interviewing.io

(03:12) Challenges in talent acquisition

(04:26) AI in interviews and its implications for technical hiring

(07:10) How technical interviews have become an arms race of memorization

(10:13) Designing a study to test the effectiveness of ChatGPT in technical interviews

(12:07) Verbatim vs. modified vs. custom questions

(16:27) The tools making cheating easier 

(19:29) Rethinking interview questions to reduce AI vulnerability

(23:58) Real-world questions for candidates and hiring teams

(28:06) How often teams should refresh their questions and make them scalable

(32:01) Engaging interviewers with custom questions

(33:31) Incentivizing interviewers and making hiring collaborative

(39:00) Balancing fairness, empathy, and efficiency in modern recruiting

(42:36) Advice on achieving hiring excellence