rob warren’s harsh critique of the submissions he got at soe
If you don’t get the Sociology of Education newsletter, or even if you do and just don’t read it, you probably didn’t see Rob Warren’s pretty devastating criticism of the submissions he usually got when he was the editor of Sociology of Education. As a junior scholar who has sent out my own share of not-quite-formed papers, his points are well taken, and my hunch (and what I’ve heard from editors) is that these complaints extend to other major journals as well. Read the whole thing at his website, but here’s a sample:
Most of the papers that I read had one or both of two basic problems:
First, a large percentage of papers had fundamental research design flaws. Basic methodological problems—of the sort that ought to earn a graduate student a B- in their first-year research methods course—were fairly common.4 (More surprising to me, by the way, was how frequently reviewers seemed not to notice such problems.) I’m not talking here about trivial errors or minor weaknesses in research designs; no research is perfect. I’m talking about problems that undermined the author’s basic conclusions. Some of these problems were fixable, but many were not.
Second, and more surprising to me: Most papers simply lacked a soul—a compelling and well-articulated reason to exist. The world (including the world of education) faces an extraordinary number of problems, challenges, dilemmas, and even mysteries. Yet most papers failed to make a good case for why they were necessary. Many analyses were not well motivated or informed by existing theory, evidence, or debates. Many authors took for granted that readers would see the importance of their chosen topic, and failed to connect their work to related issues, ideas, or discussions. Over and over again, I kept asking myself (and reviewers also often asked): So what?