December 10, 2012
In a previous article (All the Marbles, June 14, 2011), I discussed the century-old idea that polling a large group of people about a quantity, then averaging the response, gets you quite close to the actual quantity. One essential point, however, it that the individuals in the group possess some knowledge about the quantity. It would do no good asking persons on the street the most likely mass of the Higgs boson; but, questioning a group of particle physicists would give you a reasonable "guesstimate."
This idea of the "wisdom of the crowd" goes back to Victorian polymath, Francis Galton. In 1906, Galton observed a contest in which 800 visitors to a livestock fair guessed the weight of meat that would be produced by a particular ox.
A hundred years ago, people who would attend such a fair had reasonable knowledge of what a pound weight looked like "on the hoof," and how much of an ox would be useful meat. No individual guessed the exact weight, and there was quite a range of estimates, but Galton found that the mean of the 800 guesses was within a pound of the actual weight of 1,197 pounds. The mean was within 0.1% of the actual value.
Statistician that he was, Galton himself would have admitted that a single experiment is merely anecdotal and not really proof of anything. That's why Stefan Krause of the Department of Electrical Engineering and Computer Science at the Lübeck University of Applied Sciences in Schleswig-Holstein, Germany and his colleagues did a similar experiment. In their experiment, visitors to a museum were asked to guess the number of marbles in a jar.
It's interesting that so much anecdotal information about the wisdom of crowds has been presented in the hundred years since Galton, but until recently there was a lack of further experiment. For this experiment, Krause and his team did a statistical analysis of the results that went beyond Galton's average.
They analyzed the more than 2,000 guesses received by making random groups from the total and determine the average for these groups. The analysis showed that the average guess for groups of forty or more ranked at the 99th percentile of individual estimators. Galton, with his 800 member sample, was vindicated.
Guessing the numbers of marbles in a jar is an entertaining diversion, but can the wisdom of crowds be harnessed for a useful purpose? In another article (Prognostication, January 3, 2011), I wrote how the Internet has allowed the genesis of an efficient information futures/prediction market.
Following the proverb of "putting your money where your mouth is," futures betting sites insist that you back your predictions with small amounts of money. The financial aspect forces betters to be more reasoned in their predictions. Evidence suggest that the ensemble of such predictions is about as accurate as the prognostications of "think tanks," although some would argue that's a rather low benchmark. Marcus P. Zillman has an excellent web site that contains links to many information futures market resources.
Not surprisingly, much futures betting involves politics, and the futures markets make better predictions than the polls. People may be interested in politics, but they're usually far more interested in sports. A recent article, posted on arXiv by Greg Szalkowski and Michael L. Nelson of the Department of Computer Science, Old Dominion University (Norfolk, Virginia), examines the collective wisdom of US football fans in predicting the outcome of games. Their analytical tool was the moving point-spread for bets on NFL football games.
According to Wikipedia, the concept of point-spread betting was invented by a Connecticut mathematics teacher, Charles K. McNeil. McNeil apparently became a bookmaker in Chicago in the 1940s, proving again that teachers will take higher-paying jobs when available (Even highly paid professors jump from university to university, and from chair to chair). The point spread system is an equilibrium system in that the spread will change as too many people favor one team over another, and the bookie sees that he might lose money.
Szalkowski and Nelson used point-spread data from all NFL regular-season and post-season games from 2002-2011. They found that the difference between the opening and closing values acted as a predictor of divisional winners with better than 75% accuracy, as shown in the table.
The next time someone asks for an example of how mathematics enriches our lives, you can tell them about this advance in the gambling arts.
- Stefan Krause, Richard James, Jolyon J. Fariac, Graeme D. Ruxtond and Jens Krausee, "Swarm intelligence in humans: diversity can trump ability," Animal Behaviour, vol. 81, no. 5 (May, 2011), pp. 941-948.
- Marcus P. Zillman, Information Futures Markets Web Site.
- For an interesting discussion of the futures market as it applies to politics, see Bennett Haselton, "Legalizing Online Futures Betting," Slashdot, November 19, 2012.
- Greg Szalkowski, Michael L. Nelson, "The Performance of Betting Lines for Predicting the Outcome of NFL Games," arXiv Preprint Server, November 16, 2012.
Permanent Link to this article
Linked Keywords: Invariant mass; Higgs boson; particle physics; particle physicist; guesstimate; wisdom of the crowd; Victorian; polymath; Francis Galton; livestock; fair; meat; ox; pound mass; pound weight; arithmetic mean; mean; pound; scientist; statistics; statistical; correlation and dependence; correlation; Wikimedia Commons; statistician; experiment; anecdotal evidence; Stefan Krause; Department of Electrical Engineering and Computer Science; Lübeck University of Applied Sciences; Schleswig-Holstein, Germany; museum; marble; statistical analysis; randomness; random; percentile; information futures/prediction market; proverb; put your money where your mouth is; ensemble; think tank; politics; poll; team sport; sports; arXiv; Greg Szalkowski; Michael L. Nelson; Department of Computer Science; Old Dominion University (Norfolk, Virginia); American football; fan; point-spread; National Football League; NFL; Wikipedia; Connecticut; mathematic; teacher; Charles K. McNeil; bookmaker; professor; university; chair; equilibrium system; regular-season; post-season; National Football League playoffs; divisional winners; gambling; bimodal distribution; home-field advantage.
Latest Books by Dev Gualtieri
Thanks to Cory Doctorow of BoingBoing for his favorable review of Secret Codes!
Blog Article Directory on a Single Page
- J. Robert Oppenheimer and Black Holes - April 24, 2017
- Modeling Leaf Mass - April 20, 2017
- Easter, Chicks and Eggs - April 13, 2017
- You, Robot - April 10, 2017
- Collisions - April 6, 2017
- Eugene Garfield (1925-2017) - April 3, 2017
- Old Fossils - March 30, 2017
- Levitation - March 27, 2017
- Soybean Graphene - March 23, 2017
- Income Inequality and Geometrical Frustration - March 20, 2017
- Wireless Power - March 16, 2017
- Trilobite Sex - March 13, 2017
- Freezing, Outside-In - March 9, 2017
- Ammonia Synthesis - March 6, 2017
- High Altitude Radiation - March 2, 2017
- C.N. Yang - February 27, 2017
- VOC Detection with Nanocrystals - February 23, 2017
- Molecular Fountains - February 20, 2017
- Jet Lag - February 16, 2017
- Highly Flexible Conductors - February 13, 2017
- Graphene Friction - February 9, 2017
- Dynamic Range - February 6, 2017
- Robert Boyle's To-Do List for Science - February 2, 2017
- Nanowire Ink - January 30, 2017
- Random Triangles - January 26, 2017
- Torricelli's law - January 23, 2017
- Magnetic Memory - January 19, 2017
- Graphene Putty - January 16, 2017
- Seahorse Genome - January 12, 2017
- Infinite c - January 9, 2017
- 150 Years of Transatlantic Telegraphy - January 5, 2017
- Cold Work on the Nanoscale - January 2, 2017
- Holidays 2016 - December 22, 2016
- Ballistics - December 19, 2016
- Salted Frogs - December 15, 2016
- Negative Thermal Expansion - December 12, 2016
- Verbal Cues and Stereotypes - December 8, 2016
- Capacitance Sensing - December 5, 2016
- Gallium Nitride Tribology - December 1, 2016
- Lunar Origin - November 27, 2016
- Pumpkin Propagation - November 24, 2016
- Math Anxiety - November 21, 2016
- Borophene - November 17, 2016
- Forced Innovation - November 14, 2016
- Combating Glare - November 10, 2016
- Solar Tilt and Planet Nine - November 7, 2016
- The Proton Size Problem - November 3, 2016
- Coffee Acoustics and Espresso Foam - October 31, 2016
- SnIP - An Inorganic Double Helix - October 27, 2016
- Seymour Papert (1928-2016) - October 24, 2016
- Mapping the Milky Way - October 20, 2016
- Electromagnetic Shielding - October 17, 2016
- The Lunacy of the Cows - October 13, 2016
- Random Coprimes and Pi - October 10, 2016
- James Cronin (1931-2016) - October 6, 2016
- The Ubiquitous Helix - October 3, 2016
- The Five-Second Rule - September 29, 2016
- Resistor Networks - September 26, 2016
- Brown Dwarfs - September 22, 2016
- Intrusion Rheology - September 19, 2016
- Falsifiability - September 15, 2016
- Fifth Force - September 12, 2016
- Renal Crystal Growth - September 8, 2016
- The Normality of Pi - September 5, 2016
- Metering Electrical Power - September 1, 2016
Deep Archive 2006-2008