A Cessna completed a cross-country flight without a human hand on the controls.
This is how Air France Flight 447 went down in 2009. The Airbus A330 departed Rio de Janeiro for Paris with 228 people aboard, entered severe thunderstorms over the Atlantic. Ice crystals accumulated on the pitot tubes — the sensors that measure airspeed.
The autopilot received contradictory data and disengaged, handing control back to the flight crew. But the plane had entered a stall. The pilots lacked the instinctive response to recover it — years of flying behind the autopilot had atrophied something essential.
They had become monitors of a system they no longer understood from the inside. When the system failed and the choice devolved to them, they made corrections that worsened the stall. The pilots kept pulling back on the stick. The one thing that guaranteed the plane would not fly. They had the information to know this was wrong. They simply could not act on it fast enough, or at all.
The system handles 99 percent of conditions perfectly. The operator becomes habituated to its judgment. Muscle memory atrophies.
”The autonomy trap works like this. The system handles 99 percent of conditions perfectly, the operator becomes habituated to its judgment, muscle memory atrophies. Decision-making speed deteriorates. Then the system encounters a scenario outside its training data. Ice crystals on sensors, weather the system has never learned, or an edge case no simulator ever produced. The system fails and control passes to someone whose instincts have been erased by years of redundancy. The retrofitted Cessna did not face those conditions on its route. It will not for many flights. But eventually it will. When an autonomous aircraft hits weather severe enough to exceed its programming, nobody will be sitting in the seat to recover what the machine cannot understand.
The difference between a Cessna proving autonomous flight is possible and a commercial airliner becoming genuinely safer is the difference between a demonstration and a strategy for what to do when the strategy fails. Ask yourself what skill you have stopped practicing because the system now handles it. That muscle memory is gone when you need it most.