I am going to take a moment of publisher privilege and write about a topic that is not specifically atomic, nuclear, or energy related. As I read about election predictions based on polling numbers, I am reminded of a story I learned during one of my statistics classes.
We had just learned the mathematical formula for determining the required sample size for a specified "error rate". It turns out that if you test 1000 randomly selected representatives of a given group, you will be able to predict the behavior of that group to a precision of +- 3%.
To illustrate the importance of the descriptive words - "random" and "representative" - the instructor told the famous story of the polls that predicted that Dewey would handily beat Truman in the 1948 election. That election took place in the early days of political polling. The poll was taken by telephone at a time when telephones were still luxury items. Since Dewey's supporters tended to be in the higher income classes compared to Truman's, the telephone polls included a systematic sample bias that made their results wildly inaccurate in predicting the actions of the people who voted.
There are a number of observers who are pointing out the fact that the 2010 elections might contain a different kind of telephone bias, since there is a growing population of people who do not own traditional wired telephones. Similar stories ran during the 2008 election season. According to The Pew Research Center, a recent phone sample that specifically includes cell phones in addition to land lines shifted a few points towards candidates from the Democratic Party.
Based on my own admittedly non-random sampling, I suspect that there are other technological developments that are making phone polling less and less representative of the voting population. Though I generally take the time to vote, I NEVER take the time to talk to a pollster. Like most of the people that I call, I only answer the phone if I recognize the caller ID. I let voicemail handle the sales people and the robodialers. I never return those calls.
In the rare instance when I am distracted enough to answer the phone without looking at the caller ID, I hang up without comment as soon as I recognize an autodialer, a poll or a sales pitch. (I have been told I am being rude when I quickly hang up, but I figure I am saving the person on the other end time. Is that rude or not?)
The final technological issue that is becoming more important is the growing use of texting rather than talking. Both of my twenty something daughters are more likely to answer a text from a friend than a telephone call from a stranger - quite frankly, so am I. Are my responses to attempts to intrude in my life common enough to cause an additional bias in the polls towards answers given by people with more time on their hands and less interest in using modern technology?
I am not sure what political positions the people who use cell phones, texting, and caller ID favor, but my prediction is that the final results of the upcoming election will be substantially different from the results predicted by using polls produced from surveying people who actually answer randomly placed calls and take the time to answer questions from surveyors.
Beware of Poll Predictions Based on Poorly Representative Samples
Other Posts by Rod Adams
Nuclear fission qualifies as “ultra low carbon” power; natural gas does not - May 7, 2012
ExxonMobil is betting that natural gas will NOT remain cheap - April 19, 2012
Powering America (and the world) with nuclear energy - March 9, 2012
Combining Domestic Coal with Nuclear Energy to Make Oil? - March 3, 2012
Sierra Club admits taking money to promote natural gas over coal - February 7, 2012
» Already a member? Login now to comment!
» Not a member? Register to comment!
Seattle said:
Ironically people with more time on their hands - vote in higher numbers. Maybe those people that answer the poll have a higher interest in politics in general and are really more likely to vote anyhow. Each pollster puts their name and reputation on the line when they conduct a poll. They get more work the next election on the bias of how good their last poll was. So check out which poll predictions are accurate this season and listen to them next season.BillWoods said:
Nate Silver has written about this. It's a pretty murky picture:
What seems reasonably clear is this: If you use the types of weighting techniques that Pew uses, you’ll have a lot of problems if you don’t include cellphones in your sample. But this won’t necessarily hold if you use a different set of weighting methods. SurveyUSA, for instance, which conducts surveys by automated script (i.e. “robopolls”), attempted a similar study and found little evidence of bias.
http://fivethirtyeight.blogs.nytimes.com/2010/10/14/bypassed-cellphones-biased-polls/
RebeccaLutzy said:
Rod - I extended your publisher priviledge to The Energy Collective and chose to re-post this insightful post. Although not explicitly about energy and environment policy, the outcome of races in the upcoming midterm election will have a signifcant impact on the future of energy and climate policy in the U.S., perhaps a larger impact than the 2008 election.
-
Baby You Can Drive My (Electric) Car
Posted May 11, 2012 by Scott Edward Anderson
-
Siemens develops ABS plastic alternative
Posted May 9, 2012 by Doris de Guzman
-
Reduce CO2 and Slow Global Warming?
Posted April 30, 2012 by Willem Post
-
WGC 2012 - 25th World Gas Conference
June 4, 2012, Kuala Lumpur, Malaysia
-
Ecwatech 2012
June 4, 2012, Moscow, Russia
-
Intersolar Europe
June 11, 2012, Munich, Germany
Scott Edward Anderson is a consultant, blogger, and media commentator who blogs at The Green Skeptic. More »
Marc Gunther is a writer, speaker and consultant, who focuses on business and the environment. More »
Christine Hertzog is a consultant, author, and a professional explainer focused on Smart Grid. More »
Jesse Jenkins is the director of energy and climate policy at the Breakthrough Institute. More »
Robert Rapier works in the energy industry and writes and speaks about energy and the environment. More »
Geoffrey Styles is Managing Director of GSW Strategy Group, LLC and an award-winning blogger. More »
Dan Yurman is a nuclear energy blogger and writes regularly for Fuel Cycle Week. More »
The Energy Collective
- YOU
- Rod Adams
- Scott Edward Anderson
- Charles Barton
- Barry Brook
- Dick DeBlasio
- Simon Donner
- Big Gav
- Michael Giberson
- James Greenberger
- Lou Grinzo
- Marc Gunther
- Tyler Hamilton
- Christine Hertzog
- David Hone
- Jesse Jenkins
- Lynne Kiesling
- Sonita Lontoh
- Jesse Parent
- Vicky Portwain
- Tom Raftery
- Robert Rapier
- Joseph Romm
- Robert Stavins
- Robert Stowe
- Geoffrey Styles
- Alex Trembath
- Gernot Wagner
- John Whitehead
- Dan Yurman
NERC CIP Compliance Training
When: Thu, 2012-05-24 08:00
Hidroenergia 2012
When: Thu, 2012-05-24 09:00
Webinar on Transported Asset Protection Association’s (TAPA) Freight Security Requirements and Trucking Security Requirements
When: Thu, 2012-05-24 14:00
Global JOJOBAWORLD 2012
When: Fri, 2012-05-25 09:00
NESCO Town Hall: Security Risk Management Practices for Electric Utilities
When: Wed, 2012-05-30 13:00
Ecwatech 2012
When: Mon, 2012-06-04 09:00

About Social Media Today




