Emerging Democratic Majority about this site | contact | search | home 
Emerging Democratic Majority
get the EDM newsletters  Navigation - Sign Up
EDM Newsletter Donkey Rising

« Strategy Notes:
John Belisarius

How Big A Role Did Fraud, Ballot Theft and Suppression of the Vote Play in The Election? | Main | God, Guns and Gays: Testing the Conventional Wisdom About the 2004 Election »


November 12, 2004

Do the Exit Polls Indicate Voter Fraud?

There are two lines of analysis that are typically used to justify the claim that the 2004 election result was somehow stolen by the GOP. The first is various bits and pieces of "evidence"--the precincts in Cuyahoga County, Ohio with more votes than registered voters, the counties in Florida (Baker, Holmes) with huge Bush margins but big Democratic registration advantages, etc.--that supposedly indicate vote tampering. I find this evidence profoundly unconvincing and think Farhad Manjoo and others have it basically right: there's not a lot of there there. Vote tampering does not appear to have happened on the scale necessary to affect this election.

The second line of analysis invokes the now-infamous early releases of the NEP exit poll data, which showed Kerry with a 3 point national lead, solidly ahead in Ohio and also leading in Iowa, Nevada and New Mexico. The reasoning, laid out most clearly in a paper, "The Unexplained Exit Poll Discrepancy", by Steven Freeman of the University of Pennsylvania, is that exit polls are very accurate surveys and highly unlikely to produce the results referred to above by chance if the real world results truly were +3 Bush, etc. Therefore, the reasoning goes, our measurement of the real world (the actual vote counts) must be wrong and the original exit poll results right. Conclusion: there's something very funny going on with this election.

But there is a huge problem with this line of reasoning. The exit polls have always drawn samples that are off the real world results and have always had to be corrected (weighted) to eliminate bias, reflect new turnout patterns and, in the end, just flat-out conform to the election results. This year is no different (though it is possible that the magnitude of these corrections has been greater than normal).

Here is my understanding of how the exit poll samples are weighted, based on what I have been able to ferret out so far. (No doubt, I'm not getting it entirely right, but it's damnably difficult to track down good information about this--exit pollsters have never made much effort to publicly explain and document their methods.)

1. Samples are weighted to correct for oversampling of precincts (for example, exit polls have historically selected minority precincts in some states at higher rates than other precincts) and for non-response bias (exit poll interviewers try to keep track of refusers by sex, race and age).

2. Samples are weighted to correct for changing turnout patterns in the current election, since the sample design is based on past turnout behavior.

3. Samples are, in end, simply weighted to correspond to the actual election results. This is done by first weighting exit poll results in sample precincts to the true precinct results, as they are known, and then weighting the overall sample to the overall election result, once it is known.

At what point are these various weighting procedures performed? That's difficult to say because of the lack of public documentation of exit pollsters' methods. But it appears to be the case that weighting of flavors one and two takes place at least partially during the day (and continuously through the day), while the third flavor naturally has to wait until actual election results start to become available.

So where were we in this extremely complicated weighting process when those first +3 Kerry exit polls hit the CNN website? Who knows? (And exit pollsters have not exactly clarified the issue since).

But it's certainly clear that those data had not yet been weighted (or at least very much) to reflect the actual election outcome (again, part of standard exit poll procedure, not anything peculiar to this year). But how much had they been weighted to reflect the other factors (1. and 2.) mentioned above?

Possibly much of this weighting had already been done. If so, then the rest of the sample correction--that took their data from +3 Kerry to +3 Bush--was done by good old-fashioned weighting to the election outcome. Or perhaps it was some combination of additional weighting for factors 1. and 2. plus weighting to the election outcome.

Who knows? Again, exit pollsters don't seem to be particularly eager to share this information. Nor do they seem particularly eager to clarify how common it has historically been for exit poll samples at that time on election day to be that far off from the actual election result.

The issue of historical comparisons is an important one. Part of what has led to the brouhaha over this year's exit poll is people's lack of knowledge about how exit polls have been conducted in the past.

Consider this. The unweighted--completely unweighted--data from the last four presidential elections before this year are as follows:

1988: Dukakis, 50.3; Bush, 49.7

1992: Clinton, 46; Bush, 33.2

1996: Clinton, 52.2; Dole, 37.5

2000: Gore, 48.5; Bush, 46.2

President Dukakis? Obviously, the unweighted data have always been highly problematic and--interestingly--have always shown a strong Democratic bias. Now these unweighted data from past years do not, admittedly, correspond to where we were in the weighting process on election night this year when the +3 Kerry poll hit the 'net--those data had presumably already been weighted to some extent to correct for factors 1. and 2.--but it is still food for thought.

Of course, it's entirely possible that exit poll samples this year, controlling for similar points in the weighting process, were more "off" than in past years. I can't say at this point and I urge the NEP to make the appropriate historical comparisons available to answer the question. But, even if so, this is hardly evidence of skulduggery in the real world; much more likely it reflects the enormous--and perhaps increasing--difficulties of conducting surveys of this complexity in a rapidly changing country.

Of course, additional inaccuracy in the exit poll samples this year (if true) is not a development completely devoid of implications. It could mean that some of the specific results from the survey are less reliable than in the past. (I personally have my doubts about some of the numbers, like those for Hispanics.) But that's a far cry from assuming an election has been somehow stolen or tainted.

My advice: calm down and concentrate on what's really important--beating them next time.

Posted by Ruy Teixeira at 11:18 PM | link

 



EDM Newsletter


The Incredible Shrinking National Security Gap (Apr 13) By Ruy Teixeira


Oh, Those Liberal College Students! (Apr 12) By Ruy Teixeira


What Does the Public Want on Immigration? (Apr 5) By Ruy Teixeira


Exurbia: The Democrats' Next Frontier (Mar 31) By Ruy Teixeira


2006 Election Outlook: The Macro and the Micro (Mar 30) By Ruy Teixeira


2006 Campaign Watch (Mar 24) By Ruy Teixeira


The Iraq War, Three Years On (Mar 22) By Ruy Teixeira


Will the Real Swingers Please Stand Up? (Mar 22) By Alan Abramowitz


Did the Bin Laden Tape Tip the Election to Bush? (Mar 21) By David Gopoian


The UN: Good Idea, Bad Execution (Mar 16) By Ruy Teixeira


Strong Disapproval Matters (Mar 10) By Alan Abramowitz


The Great Bail-Out (Mar 8) By Ruy Teixeira


Unmarried America: Demographics and Attitudes (Mar 1) By Ruy Teixeira


Weekly analysis of latest public opinion polls by Ruy Teixeira.


» Public Opinion Watch

EDM - The Book


An overview of the influential book.


EDM - The Book

»Read the commentary
» Read articles by John Judis and
Ruy Teixeira

» Buy the book

 
Articles by Ruy Texieira


"The Battle for the Exurbs" by Ruy Teixeira (New York Times)


"Movement Interruptus" by Ruy Teixeira and John B. Judis (American Prospect)


"Old Democrats and the Shock of the New" by Ruy Teixeira (Varieties of Progressivism in America)


"Would Reagan Recognize the GOP?" by John B. Judis (TNR)


"Reality Check" by Ruy Teixeira (contribution to Boston Review forum on "How the Democrats Can Win")


"White Flight: Bush Loses His Base" by John B. Judis and Ruy Teixeira (TNR)


"Don't Mourn, Mobilize" by Ruy Teixeira (American Prospect)


"Newer Democrats" by Ruy Teixeira (The Gadflyer)


"Emerging Democrats" by Ruy Teixeira (Prospect, UK)


"How Kerry Could Beat Bush" by Ruy Teixeira (Salon.com)


Review of Zell Miller's A National Party No More and Stanley Greenberg's The Two Americas by Ruy Teixeira (January-February Washington Monthly)


"The Nonsouthern Strategy" by Cliff Schecter and Ruy Teixeira (February American Prospect)


The Emerging Democratic Majority is now available in paperback. You can buy it here. Read an excerpt from the new afterword here.

Recent Entries

Dems' Game Plan Taking Shape (Jul 3)

GOP '06 Strategy Hinges on Iraq, Terrorism(Jul 2)

LA Times Poll: Dems Pulling Ahead in Congressional Races(Jun 30)

SCOTUS Redistricting Decision and Dems' Future(Jun 29)

GQR Survey Reveals Swing Voter Priorities(Jun 28)

Dems Take Lead in Midwest Bellwether(Jun 27)

Stampede of the Rinos or Ain't Nuthin' the Matter With Kansas(Jun 26)

Can Dems Match GOP Ground Game?(Jun 25)

Confronting the "Cut and Run" Label(Jun 22)

'Mapchanger Attitude' Needed for a Blue America(Jun 21)


Search The Archive
Keyword: 

 
Archives

July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003


Internet Resources


Blogs

Eric Alterman
Angry Bear
Bull Moose (Marshall Wittmann)
Centerfield
Campaign Confidential (E.J. Kessler)
Juan Cole
Columbia Journalism Review
  Campaign Desk

Joe Conason
Daily Kos
The Decembrist (Mark Schmitt)
Brad DeLong
Democracy Arsenal (Security and
  Peace Institute)

Eschaton
Facing South (Institute for
  Southern Studies)

Gadflyer Fly Trap
GoozNews (Merrill Goozner)
The Left Coaster
LiberalOasis
MyDD (Jerome Armstrong)
Mystery Pollster
NewDonkey (Ed Kilgore)
New Democrat Network
Political Animal (Kevin Drum)
Political State Report
Political Strategy
Political Wire (Taegan Goddard)
Politics1
PolySigh
Radical Middle
The Plank (New Republic)
Swing State Project
Talking Points Memo
TPM Cafe
TAPPED (American Prospect)
Think Progress (Center for American Progress)
Third Estate (Publius)
War and Piece (Laura Rozen)
Washington Note (Steve Clemons)
The Yellin Report
Matthew Yglesias

Online Magazines and Digests

BuzzFlash Report
CommonDreams 
Gadflyer
Moving Ideas
Salon
Slate 
Tom Paine

Print Magazine Web Sites

American Prospect
Atlantic Monthly
Blueprint
Boston Review
Dissent
Foreign Policy
London Review of Books
Nation
National Interest
New Left Review
New Republic
New York Review of Books
New Yorker
Policy Review
Prospect (UK)
Public Interest
Washington Monthly
Weekly Standard

Think Tanks

American Enterprise Institute
Brookings Institution
Center for American Progress
Center for Budget and Policy
  Priorities

Center for Economic and Policy
  Research

The Century Foundation
Citizens for Tax Justice
Economic Policy Institute
Financial Markets Center
New America Foundation
Urban Institute

Organizations

America Coming Together
Campaign for America's Future
Democratic Leadership Council
Democratic National Committee
Democrats.com
MoveOn.org
New Democrat Network
Progressive Democrats of America
Third Way


Internet Resources


Recent Polls

ABC News
AEI public opinion studies
American Research Group
Annenberg Election Survey
CBS News
Democracy Corps
Economist/YouGov
Fox News
Gallup
Greenberg Quinlan Rosner
GW Battleground
Harris
Hotline/Westhill Partners
IBD/CSM/TIPP
ICR
Ipsos/Associated Press
Kaiser Family Foundation
Los Angeles Times
Marist College
National Election Studies
Newsweek
Pew Research Center
Phi Delta Kappa education polls
Polling Report
Pollkatz's Pool of Polls
Public Agenda
Program on International Policy
  Attitudes

Quinnipiac University
Rasmussen Reports
RealClear Politics polling data
  roundups

Roper Center presidential approval
  series

Survey USA
Time/SRBI
USA Today
Wall Street Journal/NBC News
Washington Post/ABC News
Zogby

2004 Election Data

CNN election results
CNN NEP exit poll results
Dave Leip's election atlas
Democracy Corps postelection
  survey

Los Angeles Times exit poll
MSNBC NEP exit poll results
New York Times exit poll data
  spreadsheet

New York Times portrait of the
  2004 electorate

WCVI Hispanic exit poll

2002 Election Data

CNN election results
Democracy Corps postelection
  survey

Los Angeles Times California exit poll

2000 Election Data

CNN election results
Dave Leip's election atlas
Democracy Corps postelection
  survey

Los Angeles Times exit poll
New York Times portrait of the 2000
  electorate

VNS exit poll

 

 

 

 

 


 Dialogue Among Dems | The Strategy Center | EDM - The Book | About This Site
 
Contents Copyright © 2003-2004 by Ruy Teixeira
 
Powered by Movable Type 3.11

XML RSS