Emerging Democratic Majority about this site | contact | search | home 
Emerging Democratic Majority
get the EDM newsletters  Navigation - Sign Up
EDM Newsletter Donkey Rising

« Welcome to the New Donkey! | Main | Zogby Poll of Likely Voters Shows Bush 46%, Kerry 44% »


September 2, 2004

Adventures in Likely Voter Land

It has not escaped my notice that many people are puzzled as to how exactly polls go about determining "likely voters" (LVs). There's a good reason for this: polling firms or sponsors rarely put much effort into explaining, clearly and precisely, the mechanics of how they select these LVs.

So, as a public service, here's how they do it. Let's start with Gallup. According to David Moore of Gallup:

Gallup asks each [RV] respondent seven LV screening questions, and gives each person an LV score of 0 to 7. [Assuming a turnout of 55 percent], the top 55% are classified as likely voters.

In practice that typically means all of the "7"s--given full weight--plus some proportion of those with lower scores (usually the "6"s), who are weighted down so that the size of the likely voter sample matches the projected turnout for the year (apparently 55 percent this year). All other voters are discarded from the sample.

What are the Gallup likely voter questions? Unfortunately, the exact questions and their wording are not released by Gallup along with their polling data, but the questions apparently involve past voting behavior, interest in the election, intention to vote in the election and knowledge of things like the location of the local polling place.

That's how Gallup does it. What about other organizations--do they select likely voters in the same way? Nope, they don't. CBS News doesn't use a cut-off model, where low-scoring respondents are thrown out altogether, but instead includes everyone in their RV sample, in some form, in their LV sample. They do this by asking respondents a series of voting-related questions and then assigning each respondent a weight based on their score on these questions, from very high weights for high-scoring respondents to very low weights for low-scoring respondents.

Finally, by far the most common way is simply to ask a few screening questions and then terminate the interview with those respondents who give the "wrong" answers. Or only one question; some likely voter screens are as simple as asking an RV how likely they are to vote in the upcoming election; if they don't say "almost certain" or "probably", out they go.

So that's how they get the likely voters in the polls you read about. How do they know that likely voters, months before the election, are actually the voters who will show up on election day? They don't.

Here's David Moore from Gallup again: "We simply do not know, nor can we know, which model is better during the campaign itself. " Exactly. So why does he think the Gallup LV model works so well months and months before the election. Because "if it is the most accurate model just before the election, it is probably the most accurate during the campaign as well".

But that doesn't follow at all. The Gallup LV model could work perfectly right before the election (not that it really does, but that's another discussion) and still be quite a biased instrument earlier in the campaign. Pretty much by definition, Gallup's LVs months before the election are not the same voters as Gallup's LVs right before the election, since voters answer the LV questions differently at different stages of the campaign. And if there is any kind of partisan dimension to "tune-in", so that, say, Democratic partisans or groups that lean strongly Democratic (like minorities) tend to tune in later, that means the LV model will have a systematic tendency to, on average, favor the party (the Republicans) whose partisans or groups tune in the earliest.

Of course, my hypothesis here about Gallup LV bias might be completely wrong. But to evaluate it, Gallup would have to make available the demographics and partisan breakdown of the both its RV and LV samples for the polls it releases plus, ideally, the results (including demographics and partisan breakdowns) of the various screening questions it uses. I'm not holding my breath.

Posted by Ruy Teixeira at 10:17 PM | link

 



EDM Newsletter


The Incredible Shrinking National Security Gap (Apr 13) By Ruy Teixeira


Oh, Those Liberal College Students! (Apr 12) By Ruy Teixeira


What Does the Public Want on Immigration? (Apr 5) By Ruy Teixeira


Exurbia: The Democrats' Next Frontier (Mar 31) By Ruy Teixeira


2006 Election Outlook: The Macro and the Micro (Mar 30) By Ruy Teixeira


2006 Campaign Watch (Mar 24) By Ruy Teixeira


The Iraq War, Three Years On (Mar 22) By Ruy Teixeira


Will the Real Swingers Please Stand Up? (Mar 22) By Alan Abramowitz


Did the Bin Laden Tape Tip the Election to Bush? (Mar 21) By David Gopoian


The UN: Good Idea, Bad Execution (Mar 16) By Ruy Teixeira


Strong Disapproval Matters (Mar 10) By Alan Abramowitz


The Great Bail-Out (Mar 8) By Ruy Teixeira


Unmarried America: Demographics and Attitudes (Mar 1) By Ruy Teixeira


Weekly analysis of latest public opinion polls by Ruy Teixeira.


» Public Opinion Watch

EDM - The Book


An overview of the influential book.


EDM - The Book

»Read the commentary
» Read articles by John Judis and
Ruy Teixeira

» Buy the book

 
Articles by Ruy Texieira


"The Battle for the Exurbs" by Ruy Teixeira (New York Times)


"Movement Interruptus" by Ruy Teixeira and John B. Judis (American Prospect)


"Old Democrats and the Shock of the New" by Ruy Teixeira (Varieties of Progressivism in America)


"Would Reagan Recognize the GOP?" by John B. Judis (TNR)


"Reality Check" by Ruy Teixeira (contribution to Boston Review forum on "How the Democrats Can Win")


"White Flight: Bush Loses His Base" by John B. Judis and Ruy Teixeira (TNR)


"Don't Mourn, Mobilize" by Ruy Teixeira (American Prospect)


"Newer Democrats" by Ruy Teixeira (The Gadflyer)


"Emerging Democrats" by Ruy Teixeira (Prospect, UK)


"How Kerry Could Beat Bush" by Ruy Teixeira (Salon.com)


Review of Zell Miller's A National Party No More and Stanley Greenberg's The Two Americas by Ruy Teixeira (January-February Washington Monthly)


"The Nonsouthern Strategy" by Cliff Schecter and Ruy Teixeira (February American Prospect)


The Emerging Democratic Majority is now available in paperback. You can buy it here. Read an excerpt from the new afterword here.

Recent Entries

Dems' Game Plan Taking Shape (Jul 3)

GOP '06 Strategy Hinges on Iraq, Terrorism(Jul 2)

LA Times Poll: Dems Pulling Ahead in Congressional Races(Jun 30)

SCOTUS Redistricting Decision and Dems' Future(Jun 29)

GQR Survey Reveals Swing Voter Priorities(Jun 28)

Dems Take Lead in Midwest Bellwether(Jun 27)

Stampede of the Rinos or Ain't Nuthin' the Matter With Kansas(Jun 26)

Can Dems Match GOP Ground Game?(Jun 25)

Confronting the "Cut and Run" Label(Jun 22)

'Mapchanger Attitude' Needed for a Blue America(Jun 21)


Search The Archive
Keyword: 

 
Archives

July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003


Internet Resources


Blogs

Eric Alterman
Angry Bear
Bull Moose (Marshall Wittmann)
Centerfield
Campaign Confidential (E.J. Kessler)
Juan Cole
Columbia Journalism Review
  Campaign Desk

Joe Conason
Daily Kos
The Decembrist (Mark Schmitt)
Brad DeLong
Democracy Arsenal (Security and
  Peace Institute)

Eschaton
Facing South (Institute for
  Southern Studies)

Gadflyer Fly Trap
GoozNews (Merrill Goozner)
The Left Coaster
LiberalOasis
MyDD (Jerome Armstrong)
Mystery Pollster
NewDonkey (Ed Kilgore)
New Democrat Network
Political Animal (Kevin Drum)
Political State Report
Political Strategy
Political Wire (Taegan Goddard)
Politics1
PolySigh
Radical Middle
The Plank (New Republic)
Swing State Project
Talking Points Memo
TPM Cafe
TAPPED (American Prospect)
Think Progress (Center for American Progress)
Third Estate (Publius)
War and Piece (Laura Rozen)
Washington Note (Steve Clemons)
The Yellin Report
Matthew Yglesias

Online Magazines and Digests

BuzzFlash Report
CommonDreams 
Gadflyer
Moving Ideas
Salon
Slate 
Tom Paine

Print Magazine Web Sites

American Prospect
Atlantic Monthly
Blueprint
Boston Review
Dissent
Foreign Policy
London Review of Books
Nation
National Interest
New Left Review
New Republic
New York Review of Books
New Yorker
Policy Review
Prospect (UK)
Public Interest
Washington Monthly
Weekly Standard

Think Tanks

American Enterprise Institute
Brookings Institution
Center for American Progress
Center for Budget and Policy
  Priorities

Center for Economic and Policy
  Research

The Century Foundation
Citizens for Tax Justice
Economic Policy Institute
Financial Markets Center
New America Foundation
Urban Institute

Organizations

America Coming Together
Campaign for America's Future
Democratic Leadership Council
Democratic National Committee
Democrats.com
MoveOn.org
New Democrat Network
Progressive Democrats of America
Third Way


Internet Resources


Recent Polls

ABC News
AEI public opinion studies
American Research Group
Annenberg Election Survey
CBS News
Democracy Corps
Economist/YouGov
Fox News
Gallup
Greenberg Quinlan Rosner
GW Battleground
Harris
Hotline/Westhill Partners
IBD/CSM/TIPP
ICR
Ipsos/Associated Press
Kaiser Family Foundation
Los Angeles Times
Marist College
National Election Studies
Newsweek
Pew Research Center
Phi Delta Kappa education polls
Polling Report
Pollkatz's Pool of Polls
Public Agenda
Program on International Policy
  Attitudes

Quinnipiac University
Rasmussen Reports
RealClear Politics polling data
  roundups

Roper Center presidential approval
  series

Survey USA
Time/SRBI
USA Today
Wall Street Journal/NBC News
Washington Post/ABC News
Zogby

2004 Election Data

CNN election results
CNN NEP exit poll results
Dave Leip's election atlas
Democracy Corps postelection
  survey

Los Angeles Times exit poll
MSNBC NEP exit poll results
New York Times exit poll data
  spreadsheet

New York Times portrait of the
  2004 electorate

WCVI Hispanic exit poll

2002 Election Data

CNN election results
Democracy Corps postelection
  survey

Los Angeles Times California exit poll

2000 Election Data

CNN election results
Dave Leip's election atlas
Democracy Corps postelection
  survey

Los Angeles Times exit poll
New York Times portrait of the 2000
  electorate

VNS exit poll

 

 

 

 

 


 Dialogue Among Dems | The Strategy Center | EDM - The Book | About This Site
 
Contents Copyright © 2003-2004 by Ruy Teixeira
 
Powered by Movable Type 3.11

XML RSS