« Links for 09-21-15 | Main | Paul Krugman: The Rage of the Bankers »

Monday, September 21, 2015

The Lifecycle of Scholarly Articles across Fields of Economic Research

This might interest some of you:

The lifecycle of scholarly articles across fields of economic research, by Sebastian Galiani, Ramiro Gálvez, Maria Victoria Anauati, Vox EU: Citation counts stand as the de facto methodology for measuring the influence of scholarly articles in today’s economics profession. Nevertheless, a great deal of criticism has been made of the practice of naively using citation analysis to compare the impact of scholarly articles without taking into account other factors which may affect citation patterns (see Bornmann and Daniel 2008).
One recurrent criticism focuses on ‘field-dependent factors’... In a recent paper (Anauati et al. 2015), we analyze if the ‘field-dependent factors’ critique is also valid for fields of research inside economics. Our approach began by assigning into one of four fields of economic research (applied, applied theory, econometric methods and theory) every paper published in the top five economics journals –  The American Economic Review, Econometrica, the Journal of Political Economy, The Quarterly Journal of Economics, and The Review of Economic Studies.
The sample consisted of 9,672 articles published in the top five journals between 1970 and 2000. It did not include notes, comments, announcements or American Economic Review Papers and Proceedings issues. ...

What did they find?:

Conclusions Even though citation counts are an extremely valuable tool for measuring the importance of academic articles, the patterns observed for the lifecycles of papers across fields of economic research support the ‘field-dependent factors’ inside this discipline. Evidence seems to provide a basis for a caveat regarding the use of citation counts as a ‘one-size-fits-all’ yardstick to measure research outcomes in economics across fields of research, as the incentives generated by their use can be detrimental for fields of research which effectively generate valuable (but perhaps more specialized) knowledge, not only in economics but in other disciplines as well.
According to our findings, pure theoretical economic research is the clear loser in terms of citation counts. Therefore, if specialized journals' impact factors are calculated solely on the basis of citations during the first years after an article’s publication, then theoretical research will clearly not be attractive to departments, universities or journals that are trying to improve their rankings or to researchers who use their citation records when applying for better university positions or for grants. The opposite is true for applied papers and applied theory papers – these fields of research are the outright winners when citation counts are used as a measurement of articles' importance, and their citation patterns over time are highly attractive for all concerned. Econometric method papers are a special case; their citation patterns vary a great deal across different levels of success.

    Posted by on Monday, September 21, 2015 at 12:51 AM in Academic Papers, Economics | Permalink  Comments (1)


    Feed You can follow this conversation by subscribing to the comment feed for this post.