Skip to main content

The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

Join now

HuffPo says Nate Silver is “just guessing.” Silver calls HuffPo “idiotic.” Who’s right?

AWXII - Day 1
AWXII - Day 1
Photo by Slaven Vlasic/Getty Images for AWXII

In normal times, people don’t get animated about polling methodology. But this weekend is not a normal time. And so on Saturday, the internet was treated to a bitter Twitter feud between a prominent polling analyst and a Washington journalist: FiveThirtyEight’s Nate Silver and the Huffington Post’s Ryan Grim.

Silver’s polling model currently gives Hillary Clinton only a 65 percent chance of winning the White House, which makes it the most pessimistic of the major polling models. The Huffington Post, in contrast, gives Clinton an astronomical 98 percent chance of winning.

On Saturday, Grim penned an article savaging Silver’s methodology and comparing it to “unskewing” websites that showed Mitt Romney ahead in the 2012 presidential election. Those are fighting words in the polling world, since these adjustments turned out to be totally wrong — President Obama ultimately won re-election by an even wider margin than polling had predicted.

Grim claimed that Silver is doing something similar, making adjustments to polling results that are “merely political punditry dressed up as sophisticated mathematical modeling.”

That inspired a heated response from Silver:

The big dispute is about “trend line adjustments”

The centerpiece of Grim’s case against Silver’s model is something called trend line adjustment. Silver is trying to solve a problem that all poll averages face: what to do with older polls, especially in the midst of a volatile race.

For example, we know that the race has tightened significantly since mid-October. So when computing poll averages, it would be silly to simply throw 3-week-old polls into the mix as though they’re as relevant as the latest polls.

There are a few different ways to deal with this problem. One option is to just throw out older polls, the approach favored by the RealClearPolitics polling average.

Another option — the one chosen by FiveThirtyEight — is to try to adjust the past poll results to reflect the overall national trend. One advantage of this approach is that some states are polled infrequently, so projecting older polls forward can provide an educated guess about what the state would look like if it were polled today.

As Silver explains it: “if Trump led in a North Carolina poll by 1 percentage point in June, but the trend line shows him having gained 3 percentage points nationally since then, the model will treat the poll as showing him up by 4 percentage points.”

The trend line is calculated by comparing different editions of the same poll. For example, Silver explains, “if Clinton is at 46 percent in the Quinnipiac poll of Florida in August and was at 43 percent in the same poll in July, that suggests she’s gained 3 percentage points.”

Grim’s crack about trend line adjustment being “merely political punditry dressed up as sophisticated mathematical modeling” is unfair. Silver’s model is adjusting older polls in a pro-Trump direction because newer polls have shown a closer race.

If polls had moved toward Clinton instead of Trump in the last few weeks, Silver’s trend line adjustment would have given older polls a pro-Clinton bump. It has nothing to do with “punditry.”

Silver also argues that the trend line adjustment is a bit of a red herring in explaining the difference between Silver’s 65 percent chance of a Clinton win and the Huffington Post’s 98 percent probability.

Silver’s model assumes that there’s a wider range of possibilities than the Huffington Post model does. One reason for this, Silver says, is that the FiveThirtyEight model assumes greater correlation among state results, so that if Trump surges in one state he’s likely to surge in others too.

See More:

More in Politics

The Logoff
Trump’s ceasefire announcement, briefly explainedTrump’s ceasefire announcement, briefly explained
The Logoff

An Israel-Lebanon ceasefire is set to take effect Thursday evening.

By Cameron Peters
Podcasts
What to know about the Israel-Lebanon conflictWhat to know about the Israel-Lebanon conflict
Podcast
Podcasts

A journalist explains what it’s like in Lebanon right now.

By Avishay Artsy and Sean Rameswaram
Today, Explained newsletter
Trump’s bungled Iran negotiations didn’t have to go this wayTrump’s bungled Iran negotiations didn’t have to go this way
Today, Explained newsletter

Wendy Sherman helped Obama reach a deal with Iran. She sees several areas where Trump is going wrong.

By Caitlin Dewey
The Logoff
Trump’s DOJ wants to undo January 6 convictionsTrump’s DOJ wants to undo January 6 convictions
The Logoff

How the Trump administration is still trying to rewrite January 6 history.

By Cameron Peters
Politics
Donald Trump messed with the wrong popeDonald Trump messed with the wrong pope
Politics

Trump fought with Pope Francis before. He’s finding Pope Leo XIV to be a tougher foil.

By Christian Paz
Podcasts
A cautionary tale about tax cutsA cautionary tale about tax cuts
Podcast
Podcasts

California cut property taxes in the 1970s. It didn’t go so well.

By Miles Bryan and Noel King