Back to blog

What breaks when exams test skills AI can do for students?

Thắng Đoàn
Thắng Đoàn

You still need to know whether a student can think. The essay was that proof, and AI can now write it in minutes.

The proof of learning collapsed

Generative AI was fracturing the foundational contract between teacher, student, and assessment. When ChatGPT arrived, universities scrambled to test whether generative AI could pass their assessments, The Conversation reports. Early claims touted human-level performance on academic benchmarks and passing US bar exams. Yet their research found models performed poorly on critical legal analysis. That comfort is fading. eSchool News describes a student who submitted a reflective paper with the copy-pasted AI prompt left at the top, evidence the professor said was impossible to miss. For that teacher, generative AI was fracturing the foundational contract between teacher, student, and assessment.

  • AI has closed most of the gap on exams that test routine skills
  • One pasted prompt exposed how little take-home writing now proves

Cheating outruns the exam room

Even locked rooms are not safe. The AFR describes a third-year law student who saw printed screenshots of ChatGPT conversations on a neighbour's desk in a handwritten exam where no technology was permitted. Leak risk compounds this. Hindustan Times reports India is weighing exam reform after the NEET-UG question paper leak. Nandan Nilekani proposes generating papers on test day from a large question bank, which he says removes the incentive to steal them.

  • Printed ChatGPT transcripts appeared in a no-technology law exam
  • Nilekani's answer: build a big question bank and print the paper at the last minute

Old formats return, imperfectly

Universities are moving back to handwritten essays and oral examinations, the AFR reports. The oral exam is the blunt version of the fix: you defend your thinking in person, so nobody else can sit it for you. Nilekani's model attacks scale instead, and Hindustan Times notes he points to computer-based testing as the way to reach candidates everywhere. Each trade-off is real. Orals consume staff hours per student, handwriting penalizes some students, and instant papers demand serious infrastructure.

  • Oral exams verify the student, not just the artifact
  • AI-generated test-day papers kill leak incentives but require large-scale testing infrastructure

What this does not solve

New formats measure what happens in the exam room, not what students do across a semester. UNESCO argues AI's effects on education are massive yet often insufficiently acknowledged and discussed. None of these fixes answers the harder question the AFR frames: teaching people to think when a computer thinks faster. Restoring exam integrity does not restore the purpose of the learning being examined.

  • Orals and handwritten papers raise staffing and fairness costs
  • Integrity fixes say nothing about what humans should still learn
Which of your current assessments could an AI pass today, and how would you find out?
If every grade needed a 10-minute oral defense, what would your curriculum stop rewarding?

Pick one assignment you graded this term and try to reproduce it with an AI tool in 10 minutes.

Sources

The Conversation

eSchool News

AFR

UNESCO

Hindustan Times

Share:

Recommended for you

Enjoyed this article?

Subscribe for new articles. No spam. Unsubscribe anytime.

By subscribing you agree to receive the newsletter. No spam, and you can unsubscribe anytime.