---
id: "claim-ai-detection-impossible"
type: "claim"
source_timestamps: ["00:11:36", "00:11:58", "00:12:20"]
tags: ["edtech", "policy", "assessment"]
related: ["action-ban-ai-detectors", "open-question-assessment-redesign", "contrarian-ai-detectors-are-snake-oil", "quote-ai-detection-impossible"]
confidence: "high"
testable: true
speakers: ["Nate B. Jones"]
sources: ["s10-vibe-codes"]
sourceVaultSlug: "s10-vibe-codes"
originDay: 10
---
# AI Writing Detection Is Fundamentally Impossible And Harmful

## Claim

It is mathematically and practically impossible to detect the use of AI in student homework. Detectors lost the arms race before it began. Companies selling AI detection software to schools are selling **snake oil**.

See [[quote-ai-detection-impossible]]: 'You will never be able to detect the use of AI in homework, full stop.'

## Why The Detectors Lose

- LLMs improve faster than detectors
- Paraphrasing, light editing, or model-shopping defeats stylometric detection
- The detectors operate on flawed heuristics that produce systemic false positives

## The Active Harm

False positives ruin the academic lives and reputations of students who did not cheat. The detectors' use is therefore not just useless — it is destructive. See [[contrarian-ai-detectors-are-snake-oil]] for the moral framing.

## Empirical Backing

Widespread reports show false-positive rates of 20–30% on human writing for tools like GPTZero and Turnitin. Even tools claiming 90%+ accuracy on older models fail on paraphrased or edited AI text — confirming the arms-race futility.

## Counter-Perspective

Multimodal detectors using watermarking + stylometry have hit 95% on GPT-4o in lab settings. The position 'impossible' may overstate; 'unreliable in deployment' is more defensible. But in school settings without watermark cooperation from model providers, the practical conclusion holds.

## The Only Real Solution

Abandon take-home essays as a measure of capability (see [[claim-take-home-exams-dead]]). Return to in-class work and oral exams. The corresponding action is [[action-ban-ai-detectors]].

## Open Question

[[open-question-assessment-redesign]] addresses how higher education will scale assessment without take-home work.