We trust intermediaries to verify what we cannot verify ourselves, and the better the intermediary performs its role (the more coherent and authoritative it sounds), the more we skip the verification step entirely.
2
Stephen Aarons filed court documents citing police testimony and witness statements that the AI had simply invented. He wasn't negligent or foolish, he was human, which means he was susceptible to what all humans are susceptible to when facing a tool that sounds confident and performs expertise.
3
The next crisis isn't information scarcity, it's the collapse of lightweight verification. Every profession that depends on citation, testimony, or chain of custody is now operating on thinner ice than it knows.
W71
The Signal
Testimony under suspension
Observation
Smart people confidently cite sources that don't exist.
A lawyer in New Mexico included AI-hallucinated witnesses in a murder appeal. He believed what the machine generated. The gap between what looks credible and what is true has become invisible to the people most trained to see it. This isn't a failure of intelligence, it's a failure of the sensory organs we use to check our own work.