GUEST PODCAST: EdTechnical Season 3 Episode 2
This season EdTech funder Libby Hills and AI researcher Owen Henkel continue to speak with leading researchers, practitioners and educators on the EdTechnical podcast series about the cutting edge of AI in education. They will break down complex AI concepts into non-technical insights to better understand what the research says and help educators sift the useful insights from the AI hype.
In this episode of EdTechnical, Libby and Owen explore why traditional AI detection tools are struggling in academic settings. As students adopt increasingly sophisticated methods to evade AI detection – like paraphrasing tools, hybrid writing, and sequential model use – detection accuracy drops and false positives rise. Libby and Owen look at the research showing why reliable detection with automated tools is so difficult, including why watermarking and statistical analysis often fail in real-world conditions.
The conversation shifts toward process-based and live assessments, such as keystroke tracking and oral exams, which offer more dependable ways to evaluate student work. They also discuss the institutional challenges that prevent widespread adoption of these methods, like resource constraints and student resistance. Ultimately, they ask how the conversation about detection could lead towards more meaningful assessment.