Skip to main content

The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

Join now

The polls were skewed — against Republicans

Andrew Prokop
Andrew Prokop is a senior politics correspondent at Vox, covering the White House, elections, and political scandals and investigations. He’s worked at Vox since the site’s launch in 2014, and before that, he worked as a research assistant at the New Yorker’s Washington, DC, bureau.

This year’s Senate polls were more picked-over and modeled than ever before — and their final performance was not impressive. Yes, overall the polls pointed toward a Republican Senate takeover, and correctly predicted the victor of nearly every competitive race. (They missed the Republican victory in North Carolina, and most averages incorrectly gave Greg Orman a slight edge in Kansas.) But the margins they were showing were pretty far off the mark — very far, in several instances:

Poll error 11-05

In the chart, I've showed how far off FiveThirtyEight's projected margins were, for simplicity. But in nearly all of these races, FiveThirtyEight's estimates were within one to two points of simple poll averages like RCP's and the other models that projected margins. Just before the election, everyone was looking at the same polling.

There’s no evident pattern to where the polls were the worst. They were way off in deep-red states like Kansas, where independent Orman didn’t even come close to winning despite leading most recent polls, and Arkansas, where Sen. Mark Pryor ended up losing by 17 percentage points.

Yet polls similarly underestimated Republican performance in purple states like Virginia —which was far more close than practically anyone expected, though Democrat Mark Warner seems to have barely managed to hang on. The same held true in Iowa, where polls predicted Ernst was ahead by about two. (This means that the famously accurate Des Moines Register poll, which showed Ernst ahead by seven points, has beaten the averages yet again.)

As more votes are tallied it’s possible these margins will change somewhat. But these results present new ammunition to the analysts who place less trust in polling averages. When it comes to predicting margins, those averages gave us no indication that so many sweeping Republican victories were about to occur.

See More:

More in archives

archives
Ethics and Guidelines at Vox.comEthics and Guidelines at Vox.com
archives
By Vox Staff
Supreme Court
The Supreme Court will decide if the government can ban transgender health careThe Supreme Court will decide if the government can ban transgender health care
Supreme Court

Given the Court’s Republican supermajority, this case is unlikely to end well for trans people.

By Ian Millhiser
archives
On the MoneyOn the Money
archives

Learn about saving, spending, investing, and more in a monthly personal finance advice column written by Nicole Dieker.

By Vox Staff
archives
Total solar eclipse passes over USTotal solar eclipse passes over US
archives
By Vox Staff
archives
The 2024 Iowa caucusesThe 2024 Iowa caucuses
archives

The latest news, analysis, and explainers coming out of the GOP Iowa caucuses.

By Vox Staff
archives
The Big SqueezeThe Big Squeeze
archives

The economy’s stacked against us.

By Vox Staff