The adversarial turn in online discourse wasn't a moral failure—it was a rational response to changed incentives that happened deliberately, measurably. With full knowledge of its effects.
In 2009, Facebook's engineering team altered the News Feed algorithm in a specific way. "Soft" content like links to articles and long-form thoughts received lower distribution weight, while "engagement bait"—polarizing takes and argument-starting posts—received higher weight.
Facebook's executives knew exactly what would happen. Mark Zuckerberg had already stated publicly that the algorithm would privilege whatever kept users on the platform longest. Sean Parker admitted the explicit goal was to consume "as much of your time and conscious attention as possible."
The mechanism was transparent to them—more conflict meant more return visits, more return visits meant higher engagement metrics. Higher engagement metrics meant higher ad rates. This wasn't accidental or the inevitable result of human nature online. This was infrastructure designed to reward exactly what we now call toxic discourse. The shift happened fast enough to measure.
You cannot out-grace an algorithm that has been deliberately tuned to reward the opposite.
”Blog culture in the mid-2000s had been fundamentally different, where nuance accumulated audience loyalty over time and writers earned trust through sustained thinking rather than viral moments. Facebook made choosing unnecessary—it brought all discourse to one place and algorithmically selected for the posts that stopped your scroll. Nuance doesn't stop scrolls. Disagreement does.
By 2016, the pattern was complete. The researchers who studied the algorithm found that false information spread 6 times faster than true information on the platform. Not because people are gullible. Because false information is more likely to be surprising, more likely to trigger outrage, more likely to generate engagement. The algorithm was simply doing what it was built to do.
The prescriptive solution most people offer—that we should bring "grace" and "offline norms" to online spaces—treats platform design as neutral. It isn't. You cannot out-grace an algorithm that has been deliberately tuned to reward the opposite. Suggesting that individual civility will overcome structural incentives is like suggesting that politeness will make a slot machine stop taking your money.
The insight isn't about the internet. It's about where to look when systems behave badly. Don't start with the people using them. Start with who benefits from that behavior, and what they built to make it inevitable. That's where the actual decision happened.
Spend one day noting which posts stop your scroll—then ask whether you're drawn to nuance or outrage, and recognize what the platform's incentives are actually selecting for.