Facts are being manufactured all of the time, and, as Arbesman shows, many of them turn out to be wrong. Checking each one is how the scientific process is supposed to work; experimental results need to be replicated by other researchers. So how many of the findings in 845,175 articles published in 2009 and recorded in PubMed, the free online medical database, were actually replicated? Not all that many. In 2011, a disquieting study in Nature reported that a team of researchers over 10 years was able to reproduce the results of only six out of 53 landmark papers in preclinical cancer research.
In 2005, the physician and statistician John Ioannides published “Why Most Published Research Findings Are False” in the journalPLoS Medicine. Ioannides cataloged the flaws of much biomedical research, pointing out that reported studies are less likely to be true when they are small, the postulated effect is likely to be weak, research designs and endpoints are flexible, financial and nonfinancial conflicts of interest are common, and competition in the field is fierce. Ioannides concluded that “for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias.” Still, knowledge marches on, spawning new facts and changing old ones.
Facts are being manufactured all of the time, and, as Arbesman shows, many of them turn out to be wrong. Checking each one is how the scientific process is supposed to work; experimental results need to be replicated by other researchers. So how many of the findings in 845,175 articles published in 2009 and recorded in PubMed, the free online medical database, were actually replicated? Not all that many. In 2011, a disquieting study in Nature reported that a team of researchers over 10 years was able to reproduce the results of only six out of 53 landmark papers in preclinical cancer research.
In 2005, the physician and statistician John Ioannides published “Why Most Published Research Findings Are False” in the journalPLoS Medicine. Ioannides cataloged the flaws of much biomedical research, pointing out that reported studies are less likely to be true when they are small, the postulated effect is likely to be weak, research designs and endpoints are flexible, financial and nonfinancial conflicts of interest are common, and competition in the field is fierce. Ioannides concluded that “for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias.” Still, knowledge marches on, spawning new facts and changing old ones.