Publishing research using outdated methods I'm currently an Economics MA student doing a referee report on a paper that employs a dated empirical method. This particular method was originally created in 1980 but then improved upon in 1998 by other researchers, after they had discovered certain issues with it.

This got me thinking about how exactly those on the cutting edge of research seem to lag behind by over a decade (or more) in method and still manage to get published.

This is concerning because it shows that published researchers make mistakes and don't review all relevant research before publishing. I can imagine that in the hard sciences and medicine this would happen also, which is especially concerning knowing that those on the cutting edge could be decades behind in knowledge which has been around for a while.

Is this acceptable? If so, why?
What you call "an outdated method" another may call "the well-understood method".

In neuroscience, this is a very common occurrence. There are new techniques for analyzing different types of neural recordings coming out each month in a number of journals, and each one aims to improve on a specific aspect of a predecessor. Unfortunately, the new techniques are exactly that—new—and therefore untested against lots of data with different initial conditions. There are a good number of researchers who will simply ignore all the new techniques until people have developed them to a place of comfort. Even for those that do gain acceptance, they may not be appropriate for every type of analysis1.

I'm unfamiliar with your specific case, but I have seen similar concepts elsewhere in Econ, where older published techniques remain highly popular because (1) they're well-understood and (2) the new techniques were created to fix problems that not present in all databases, or not relevant for a given analysis. The old fogies sometimes do have something to offer.



1 In one case, a technique called DCM became widely popular in a very short period of time, and consequently was very quickly becoming widely misused. It got so bad that the authors actually published a paper titled "Ten simple rules for dynamic causal modeling" with the goal of educating researchers how to use the technique. (Biomed researchers in general don't have a great track record of performing world-class data analysis, but thats a separate story...)