About us Login Get email updates
Research
Print

Hannity quoted CBS State of the Union snap poll, ignored CBS' own caveats on poll's reliability

February 02, 2006 4:27 pm ET

Trouble viewing clip? Download: QT | WMV

SUMMARY: On the February 1 edition of Fox News' Hannity & Colmes, Sean Hannity quoted a CBS poll that showed "77 percent of the people watching [the State of the Union address] liked his [President Bush's] agenda." In doing so, Hannity touted poll results that CBS' own Bob Schieffer warned his audience may not be reliable.

10 Comments

On the February 1 edition of Fox News' Hannity & Colmes, co-host Sean Hannity quoted a CBS poll that showed "77 percent of the people watching [the State of the Union address] liked his [President Bush's] agenda." In doing so, Hannity touted poll results that CBS' own Evening News anchor Bob Schieffer warned his audience may not be reliable. Hannity ignored warnings by Schieffer and others that -- as Media Matters for America noted -- such after-speech polls offer a highly skewed indication of the public's view of the speech because those who listen or watch the speech, by and large, support the president already.

Hannity was quoting a question on the poll that actually read, "Did our [CBS'] viewers tonight approve of President Bush's proposals?" Seventy-seven percent of those polled responded that they did approve. But before reading the poll's results, Schieffer warned CBS viewers that the poll "does not necessarily reflect the feelings of the country because, traditionally, we found out, in recent years, more Republicans watch when a Republican makes the speech. More Democrats watch when a Democrat makes the speech."

Beyond the accuracy of such polls, other commentators suggest that whatever boost in overall ratings a president receives after delivering a State of the Union message, the uptick is usually short-lived. Previous snap polls show that a president experiences a temporary bump on even the most controversial issues. After the 2005 State of the Union address, a CBS News snap poll showed Bush enjoying a 12-percent boost in his Social Security proposal (from 44 percent to 56 percent), and a CNN/USA Today/Gallup poll put approval of his Social Security plan as high as 66 percent. By the next week, the Gallup poll had approval for Bush's Social Security plan back in the mid-40s. On Iraq, the CBS snap poll saw a nearly 20-point jump in approval of Bush's handling of the war in Iraq (47 percent to 64 percent). Yet, by the end of February 2005, CBS News polls witnessed Bush falling back to 45 percent.

Snap polling can also show nearly extraordinary leaps in popularity. In January 2002, an NBC News/Wall Street Journal poll found that 62 percent of Americans already felt the nation was headed in the right direction. Nonetheless, a CNN/USA Today/Gallup poll (subscription required) conducted after Bush's January 29, 2002, State of the Union address found that 90 percent of the people who watched the speech said they thought Bush's policies would help move the United States in the right direction.

From the February 1 edition of Fox News' Hannity & Colmes:

HANNITY: There seems to be just contempt for him [President Bush] -- you know -- waking up and getting out of bed and being the president. I think the president, very wisely, last night [during the State of the Union address] just stuck to his guns, and what he believes in, and made his case; and that CBS poll shows that 77 percent of people watching liked his agenda.

From CBS's January 31 coverage of Bush's State of the Union address:

SCHIEFFER: We want to give you some idea now how the president's speech went over with people watching at home. CBS News, with the help of a company called Knowledge Networks, chose, at random, 700 adults who told us they planned to watch the address tonight. We gave them WebTV so they could get on to the Internet and answer our questions about the speech.

Now, remember, this does not necessarily reflect the feelings of the country because, traditionally, we found out, in recent years, more Republicans watch when a Republican makes the speech. More Democrats watch when a Democrat makes the speech.

But, here, were the questions: Did our viewers tonight approve of President Bush's proposals? Seventy-seven percent approved; 23 percent did not. We asked them what affect the president's proposals would have on their lives: Fifty-nine percent said they would make their lives better; 9 percent said worse; 33 percent said the proposals would have no effect on them. On some issues, our survey shows the impact of the speech tonight. Fifty-two percent say the war in Iraq has been worth the cost. Just last week, just 45 percent of the same group thought so. And finally, here is a disappointment. When asked if President Bush will be able to accomplish his goals -- this will be a disappointment to the president, I should say -- 32 percent said yes, only -- and 68 percent -- 8 percent -- said no. They did not think he would be able to accomplish his goals.

Expand All Expand 1st Level Collapse All Add Comment
    • Author by kev in ga (February 02, 2006 5:01 pm ET)
         

      ...as this is one of his last opportunities to smile. These highly dubious "snap polls" will be proven very wrong very soon and then it will be back to all be tears and rage for poor Sean and his ilk.

      Lets face it, after 5 years we've all decided what we think of "W," his propoals, and the direction he's been taking all of us, and no speech is going to fundamentally change that opinion.

      Bush is toast.

      Report Abuse
    • Author by uebermeister (February 02, 2006 5:41 pm ET)
         

      If the poll really was flawed and CBS knew this going in, why even take the poll then? It looks a lot like CBS hoped for a different result and when they didn't get it, they dismissed their own poll.

      Discredited.

      Report Abuse
      • Author by deeznuts (February 02, 2006 5:47 pm ET)
           

        I don't see how.

        Report Abuse
      • Author by Lynn (February 02, 2006 5:48 pm ET)
           

        I watched the speech on CNN and they took a poll as well. They kept prefacing presentation of the results with the statement that it was highly skewed because of the reasons stated in this story. I'm with you it's a silly watse of time to even take the poll.

        Report Abuse
    • Author by bruce1ace (February 03, 2006 8:04 am ET)
         

      The poll specifically refers to viewers of the speech. Hannity referenced the results in that way. Hannity did not say that 77% of the country liked the agenda, he said that 77% of the speech viewers liked it. So there's really no problem here. MMFA is comparing apples and oranges. Schieffer s comment on reliability referred to using that 77% as a figure for the country as a whole, something Hannity never did.

      Report Abuse
      • Author by rufus t firefly (February 03, 2006 9:54 am ET)
           

        It will be interesting to see whether "77% of speech viewers" morphs into 77% of the country. Facts have a funny way of doing that if Hannity thinks he can add something to his litany of talking points, (OBL on a silver platter, etc.).

        Report Abuse
    • Author by Brabantio (February 03, 2006 9:53 am ET)
         

      "Schieffer s comment on reliability referred to using that 77% as a figure for the country as a whole, something Hannity never did."

      That's exactly where there is a problem, and it's not comparing apples to oranges. If Schieffer cites the poll and the caveat, then Hannity should cite both as well, right? Otherwise, he's clearly suggesting that it is reflective of the country as a whole.

      It's not a question of who watched the address, because the question is obviously only relevant to those people. If you are unaware that the viewership is so seriously slanted in Bush's favor, then you're naturally going to think that the viewership is representative of all political views, which makes that 77% sound like it would apply to the entire country.

      Report Abuse
      • Author by bruce1ace (February 03, 2006 3:31 pm ET)
           

        I disagree with you in this case. Hannity was hired by FOX to be an advocate for the conservative viewpoint. He is NOT a non-partisan news anchor. In this case, Hannity was directly on message and truthful with regard to that poll. If anything, it was Colmes who was responsible for pointing out what Schieffer was referring to with the poll. Hannity was under NO obligation to do so, nor should he given the job he was hired to do. Now, if he had misworded his statement to say the country agreed 77% with the agenda then I would agree with you, but he accurately cited the poll as a "viewer representation".

        Gentlemen, this is how the game is played. The Dems also have this down to a science, as factcheck.org has documented: [link to www.factcheck.org] and [link to www.factcheck.org]

        Report Abuse
    • Author by andy115 (February 03, 2006 9:58 am ET)
         

      THis is a classic example of what is often called intellectual dishonesty and why FOX is neither fair nor balanced. Yes Bruce, Hannity did not lie. But by not stating what Bob Schieffer said, Hannity is implying that those watching is representative of the country, which it clearly is not. By not pointing out the potential bias in the poll Hannity is skewing the truth. If FOX really were fair and balanced, they would've included Schieffer's disclaimer regarding the poll, or found a better more representative poll to use. AND WHERE THE HELL WAS COLMES TO POINT OUT THE OBVIOUS BS?

      Report Abuse

my.MediaMatters.org

Login  Sign Up

Push Back

Phone calls, emails and letters from the public do make a difference. Remember that to be effective you must be polite, and professional. Express your specific concerns regarding that particular news report or commentary, and indicate what you would like the media outlet to do differently in the future.