Mind · the wisdom and madness of crowds

The Crowd That Watched Itself

A crowd can out-guess its own smartest member — and there is an exact equation for why. The unsettling part is that the same equation, read backwards, tells you precisely how a wise crowd becomes a confident, wrong one. What it spends is the one thing that made it wise.

In 1906, at a country fair in Plymouth, the statistician Francis Galton watched a weight-judging competition: pay sixpence, guess the dressed weight of a fat ox after slaughter, win a prize if you're close. Eight hundred or so people entered — butchers and farmers who knew cattle, but also clerks and shopkeepers who didn't. Galton collected the tickets afterward. He was 84, a believer in the rule of experts, and he expected the data to expose the foolishness of the common voter. He found the opposite.

Of the tickets, 787 were legible. Their middlemost guess — the median, which Galton chose deliberately as the fairest "one vote, one value" verdict of the crowd — was 1207 lb. The ox's true dressed weight was 1198 lb. The crowd, as a body, was wrong by nine pounds: three-quarters of one percent.

"The result seems more creditable to the trustworthiness of a democratic judgment than might have been expected." — Francis Galton, "Vox Populi", Nature 75, 7 March 1907

IThe ox

Galton published only the shape of the crowd — a table of its percentiles — not the raw tickets. Below is that distribution, rebuilt from his printed centiles (the full reconstruction is K. Wallis, Statistical Science 2014). Drop in your own guess and see where you land against the body of the crowd.

Here is the first quiet correction. The number everyone repeats — that the crowd's guess was "right to within a pound" — is the mean, about 1197 lb. But the mean is not the statistic Galton reported. He championed the median, 1207, as the true voice of the people, and the famous near-perfect average was a footnote he added later. The crowd was astonishing either way. It just wasn't astonishing in quite the way the story tells it.

IIWhy it works — and it's not magic

A crowd's collective error is not usually smaller than its members'. It is always smaller — provably, by an exact identity. For any set of guesses and any true value:

Build a crowd. Two dials: how much its members disagree (diversity), and how much they share a bias (everyone wrong in the same direction). Watch the three quantities in the equation, and watch them balance — always.

Slide diversity up with bias at zero and the lesson is almost shocking: the individuals get worse and worse, yet the crowd stays nailed to the truth, and the fraction of members it beats climbs toward everyone. Diversity is free accuracy — but only the idiosyncratic kind, the errors that point in every direction and cancel. Now push shared bias up. The crowd's error climbs with it, and no amount of diversity rescues it. This is the honest boundary the cheerful version omits: a crowd cancels the part of the error its members don't share. The part they share — a rumour, a framing, a number everyone half-remembers — it averages straight into the answer and calls it consensus.

IIIThe madness — when the crowd watches itself

Galton's guessers never saw each other's tickets. That is the hidden condition on the whole result: their errors were independent. So what happens when a crowd can see itself — when each person, sensibly, nudges their estimate toward the room?

In 2011, Jan Lorenz and colleagues sat 144 people down to estimate real quantities about their own country — things like the number of new immigrants in a year, or the length of the Swiss border — over several rounds, paying them for accuracy. Some saw nothing of others' answers; some saw the group's estimates and could revise. The result was precise and bleak: social influence made the estimates converge — the crowd's diversity collapsed — and made people far more confident. It did not make them more accurate. Worse: as the range of guesses shrank, the true value often ended up outside it. The crowd talked itself into a tight, certain, wrong consensus.

The diversity equation tells you exactly why, with no extra psychology needed. Pulling everyone toward the average preserves that average — it adds no information — but it destroys diversity. And diversity was the crowd's entire edge. Spend it, and the collective error climbs straight back up to the average individual error. The same identity that grants the wisdom revokes it.

Below: a crowd that starts independent and slightly biased — like real estimators of a large unknown number. Set how strongly each member copies the room, then drag time forward, round by round of "talking," and watch.

Turn influence to zero and the rounds do nothing — an independent crowd stays wise forever. Turn it up and drag time forward: the cloud contracts to a confident sliver, the confidence multiplier soars, the crowd error barely moves or quietly worsens, and at some round the green truth-marker slips outside the band entirely. Everyone now agrees. Everyone is now more sure than they have any right to be. And the thing they agreed on is no closer to true than where they started — they simply burned the disagreement that was doing the work.

IVThe binary cousin — voting, juries, and Condorcet

The same shape governs yes/no decisions, where it's older still. In 1785 the Marquis de Condorcet proved his jury theorem: if each voter is independent and right more often than not, a majority vote is more reliable than any single voter, and approaches certainty as the crowd grows. The numbers are stark — with each person right just 60% of the time:

But flip each voter to below half — say a shared misconception makes everyone right only 40% of the time — and the theorem runs in reverse with equal force: a crowd of 501 such voters reaches the wrong verdict essentially every time (~0.0003% chance of being right). The lever is always independence. Correlate the voters — a pundit they all watch, a poll they all saw, a panic they all feel — and "more people" stops adding wisdom and starts amplifying whatever they share. Information cascades (Bikhchandani, Hirshleifer & Welch, 1992; confirmed in the lab by Anderson & Holt, 1997) are this failure at its sharpest: rational people, each watching the choices before them, can all rationally ignore their own private evidence and stampede — together, confidently — off a cliff.

VWhat to actually take from this

The wisdom of crowds is real, and it is not a mystery or a miracle. It is one equation: a crowd's accuracy is its members' accuracy plus their diversity. That gives a short, usable recipe, and it is mostly about protecting the second term:

• Collect before you discuss. Get independent estimates first — write them down, in private — then talk. The diversity you'd otherwise spend in the first five minutes of a meeting is the accuracy.
• Diversity beats individual brilliance for the collective answer — but only against idiosyncratic error. It is powerless against a bias everyone shares.
• Confidence is not accuracy. When a group grows more certain, ask whether it learned something or just heard itself. Lorenz's crowds did the second and couldn't tell the difference.
• Watch for the shared input. The single most dangerous thing you can do to a wise crowd is give all of it the same number to start from.