En español



Quick Links

Improving Reproducibility and Transparency in Biomedical Research

September 12, 2013

An alarming phenomenon in science that has come to our attention is the failure of many published results to reproduce. A 2011 paper in Nature Reviews: Drug Discovery by researchers from Bayer  reported that nearly two thirds of their company’s in-house attempts to replicate potential drug targets in the published literature failed. A 2012 Nature article reported that researchers at the biotech firm Amgen were able to reproduce only 6 of 53 (or 11 percent) “landmark” papers in hematology and oncology. And this past May, researchers at the University of Texas MD Anderson Cancer Center reported in PLOS ONE that roughly half of researchers at their center were unable to reproduce published data on at least one occasion.

Pie chart showing replication results for 67 studies,  20.9% were fully replicated, 11.9% partially and 64.2% not replicated (3.0 % not applicable)

These are just a few examples of an issue that is appearing across many scientific fields. The causes of the problem range from use of inappropriate statistical and analytical methods to biases and lack of independence between academic groups, to an academic and publishing environment that rewards publishing only positive results (and publishing them rapidly).

Reproducibility is the cornerstone of the scientific method and requires methodological detail and transparency to make it happen. The high irreproducibility rate we are currently seeing in the biomedical sciences is a problem on many levels. It makes people distrust the science, it wastes limited research dollars, and it discourages industry investment. It is especially problematic for translational research. Pharmaceutical companies must go to great expense to perform their own replications of published findings in order to avoid pursuing lead compounds of uncertain promise; and these concerns pertain even to findings published in the most prestigious (and highest impact) scientific journals.  

Last year, the National Institute of Neurological Disorders and Stroke held a workshop of researchers, journal editors, representatives from industry, and others to discuss what can be done about this issue. The consensus was that there is widespread poor reporting of experimental design in articles and grant applications, that animal research should follow a core set of research parameters, and that a concerted effort by all stakeholders is needed to disseminate best reporting practices and put them into practice. Subsequently an NIH ad-hoc group met to discuss how NIH institutes and centers can address the problem, and arrived at guiding principles that include improving researcher education and grant evaluation and finding ways to correct the perverse reward incentives that currently prevail for investigators.

Among several measures NIDA is taking is the issuing of a notice to investigators on improving the reporting of research methods in translational animal research. Transparency in reporting details on animal selection, sample size estimation, statistical methods, blinding, and other parameters should improve the quality of research, help other laboratories reproduce findings, and facilitate moving those findings into the clinic. NIDA will also convene workshops at upcoming scientific conferences to inform the addiction research community about the issues, and we are piloting the use of a checklist to improve the review of translational research grant applications.

This is an issue that the scientific community and I personally take very seriously. We must address the issue of reproducibility and transparency to accelerate the translation of our science into real-world treatments for addiction.

This page was last updated September 2013



The fact that there are no comments posted here is itself interesting. I have personally attempted to replicate at least two phenomena in behavioral science on several occasions and have yet to see the effect in it's most basic form. I have been told that I need to look at it only in one specific method. As a tax paying researcher this concerns me because it is exactly the sort of fuel needed to justify cutting funds for research. Those of us at smaller colleges with research labs and no federal grants have much flexibility to verify extant literature. As an educator, knowing that 60 percent of the science is not reproducible is quite concerning. What is real?

Transparency in research data

I agree with this answer but on the other hand there are many tools that we can use to discover more information about scientific researches i use embase, it is a powerful tool with many information about biomedical research. the tool have transparency in their data, to help us in quality of our research.

Find Help Near You

The following website can help you find substance abuse or other mental health services in your area: www.samhsa.gov/find-treatment. If you are in an emergency situation, people at this toll-free, 24-hour hotline can help you get through this difficult time: 1-800-273-TALK. Or click on: www.suicidepreventionlifeline.orgExternal link, please review our disclaimer.. We also have step by step guides on what to do to help yourself, a friend or a family member on our Treatment page.

Get this Publication

    Cite this article

    NIDA. (2013, September 12). Improving Reproducibility and Transparency in Biomedical Research. Retrieved from https://www.drugabuse.gov/about-nida/noras-blog/2013/09/improving-reproducibility-transparency-in-biomedical-research

    press ctrl+c to copy

    Dr. Nora Volkow: Remarks and Video Highlights

    APA 2015 meeting

    • Marijuana as a Cure for Opioid Use? Nation's Top Drug Scientist Says She's Skeptical, March 2019
    • Meet the Woman Leading the Nation's War on Addiction, October 2018
    • Aspen Ideas Festival 2018: Shining Light on Less Visible Prescription Drug Epidemics, June 2018
    • Dr. Nora Volkow on Addiction: A Disease of Free Will, May 2015
    • TEDMED, January 2015
      Why do our brains get addicted?
    • The World Science Festival, April 2014
      The Moth: The Brain's Addiction - Nora Volkow
    • CBS 60 Minutes, April 2012
      Hooked: Why Bad Habits Are Hard to Break 

    About This Blog

    Welcome to my blog, here I highlight important work being done at NIDA and other news related to the science of drug use and addiction.

    Receive Nora’s Blog Articles in your Email!
    You will only receive messages related to Nora’s Blog