social science did ok with the 2016 election but not great
People have been having meltdowns over polls, but I’m a bit more optimistic. When you look at what social science has to say about elections, it did ok last week. I am going to avoid poll aggregators like Nate Silver because they don’t fully disclose what they do and they appear to insert ad hoc adjustments. Not horrible, but I’ll focus on what I can see:
- Nominations: The Party Decides model is the standard. Basically, the idea is that party elites choose the nominee, who is then confirmed by the voters. It got the Democratic nomination right but completely flubbed the GOP nomination. Grade: C+.
- The “fundamentals” of the two party vote: This old and trusty model is a regression between two party vote share and recent economic conditions. Most versions of this model predicted a slim victory for the incumbent party. The figure above is from Seth Masket, who showed that Clinton 2 got almost exactly what the model predicted. Grade: A
- Polling: Averaged out, the poll averages before the election showed Clinton 2 getting +3.3 more points than Trump. She is probably getting about %.6 more than Trump. So the polls were off by about 2.7%. That’s within the margin of error for most polls. I’d say that’s a win. The polls, though, inflated the Johnson vote. Grade: B+.
- Campaigns don’t matter theory: Clinton 2 outspent, out organized, and out advertised Trump (except in the upper midwest) and got the same result as a “fundamentals” model would predict. This supports the view that campaigning has a marginal effect in high information races. Grade: A.
But what about the Electoral College? Contrary to what some folks may think, this is a lot harder to predict because state level polls produce worse results in general. This is why poll aggregators have to tweak the models a lot to get Electoral College forecasts and why they are often off. Also, the Electoral College is designed to magnify small shifts in opinion. A tiny shift in, say, Florida could move your Electoral College total by about 5%. Very unstable. That’s why a lot of academic steer clear of predicting state level results. All I’ll say is that you should take these with a grain of salt.