orgtheory.net

Crowdsourcing Sociology Department Rankings: 2013 Edition

TL;DR version: Click here to Vote in the OrgTheory/AOI 2013 Sociology Department Ranking Survey

As many of you are by now aware, U.S. News and World Report released the 2013 Edition of its Sociology Rankings this week. I find rankings fascinating, not least because of what you might call the “legitimacy ratchet” they implement. Winners insist rankings are absurd but point to their high placing on the list. Here’s a nice example of that from the University of Michigan. The message here is, “We’re not really playing, but of course if we were we’d be winning.” Losers, meanwhile, either remain silent (thus implicitly accepting their fate) or complain about the methods used, and leave themselves open to accusations of sour grapes or bad faith. They are constantly tempted to reject the enterprise and insist they should’ve been ranked higher, and so end up sounding like the apocryphal Borscht Belt couple complaining that the food here is terrible and the portions are tiny as well.

The best thing to do is to implement your own system, and do it better, if only to introduce confusion by way of additional measures. Omar Lizardo and Jessica Collett have already pointed out that U.S. News decided to cook the rankings by averaging the results from this year’s survey with the previous two rounds. They provide an estimate of what the de-averaged results probably looked like. Back in 20011, Steve Vaisey and I ran a poll using Matt Salganik’s excellent All Our Ideas website, which creates rankings from multiple pairwise comparisons. It’s easy to run and generates rankings with high face validity in a way that’s quicker, more fun, and much, much cheaper than the alternatives. So, we’re doing it again this year. Here is OrgTheory/AOI 2013 Sociology Department Ranking Survey. Go and vote! Chicago people will be happy to hear can vote as often as you like. So, participate in your own quantitative domination and get voting.

Advertisements

Written by Kieran

March 13, 2013 at 1:08 pm

2 Responses

Subscribe to comments with RSS.

  1. […] chez Podolny (Status Signals). C’est dans cette tradition, probablement, que s’inscrit cette tentative d’établissement d’un classement des départements de socio étatsuniens. J’ai utilisé le même outil, avec une liste des universités et autres établissements […]

    Like

  2. […] we’re running our Crowdsourced Sociology Rankings People have been looking a little more closely at the U.S. News and World Report rankings. Over at […]

    Like


Comments are closed.

%d bloggers like this: