research rating scale
Here’s how I evaluate research importance in social science. Averages, of course:
- Great problem, great solution.
- Great problem, partial/boring solution.
- Decent problem, great solution.
- Great problem, empirical/descriptive work.
- Decent problem, partial/boring solution.
- Decent problem, empirical/descriptive work.
- Small problem, any solution.
- Bizarre/highly technical approaches to any problem.
- Definitional/taxonomic/philosophical writings on any problem.
- History of social thought.
Random comments: I love good research in all categories. Social science journals usually only deal with #5 and up. Grad students dream of #1, but you usually start with something lower on the list. Great researchers can do it many ways – the once in a lifetime #1 or the expert who hammers home a bunch of #4′s. #8 may be in the eye of the beholder. European/critical theory people love #9 and #10. Strong disciplinarians would move #8 a few notches, perhaps to #5.
I am tempted to say that the trouble with this list is that the criteria for allocating items to slots 1-8 are established in the main by facts about slots 9 and 10.
Kieran
October 10, 2010 at 1:14 am
A few, misc points:
1) “great” can be subjective vis-a-vis problems AND solutions (or, at least it can take some time to truly identify them as great, or not), witness some of the reactions, and not, to Coase’s 1937 question (and Williamson’s work).
2) Do great questions map squarely with great problems?
3) Where would a paper like the 1985 Granovetter piece fit? Certainly at least some of 9 and 10 in that one (imported from anthropology), and perhaps a ‘great problem’ (though also imported) without a specific solution. Though it arguably ushered in an era in sociology.
teppo
October 10, 2010 at 2:09 am
Dude. I thought we were friends.
What makes you think that philosophical or intellectual-historical work doesn’t have problems or solutions and is categorically different from everything else?
Jacob T. Levy
October 10, 2010 at 2:22 am
I myopia a great problem, a decent problem, or just a small problem?
Philip Cohen
October 10, 2010 at 9:13 am
This list is unusable to the extent that it does not define what a “great” problem and “great” solution is as compared to less great ones. (And, it’s not adequate to say that these are merely subjective issues, as that would suggest it’s impossible to assess the quality of one solution over another…and, were that to be the case, then we should all just pack our bags and go home).
anon.
October 10, 2010 at 4:26 pm
[...] few days ago, I wrote a ranking of research and listed “history of social thought” as last. Jacob Levy wrote: Dude. I thought we were [...]
jacob levy: i still luv u, man « orgtheory.net
October 21, 2010 at 12:10 am
[...] England, of course. Recently, at Org Theory, there were two posts that I found rather annoying. The first laid out what they thought of as a “research rating scale.” At the top of the scale [...]
Theoria › Ranking Sociology?
October 22, 2010 at 6:32 pm