Group calls for more transparency in science research

An international group of academic leaders, journal editors and funding-agency representatives and disciplinary leaders, including Rick Wilson, the Herbert S. Autrey Chair of Political Science and professor of statistics and psychology at Rice University, has announced guidelines to further strengthen transparency and reproducibility practices in science research reporting.

The group, the Transparency and Openness Promotion (TOP) Committee at the Center for Open Science in Charlottesville, Va., outlined its new guidelines in a story published in this week's edition of the journal Science.

While transparency, openness and reproducibility are readily recognized as vital features of science and embraced by scientists as a norm and value in their work, a growing body of evidence suggests that those qualities are not necessarily evident today.

"A likely culprit for this disconnect is an academic reward system that insufficiently incentivizes open practices," Wilson said. "In the present reward system, the emphasis on innovation undermines practices that support openness. Too often, publication requirements - whether actual or perceived - fail to encourage transparent, open and reproducible science."

TOP's objective is to translate scientific norms and values into concrete actions and change the current incentive structures to drive researchers' behavior toward more openness.

"We know the disciplines differ in what is emphasized, so we sought to produce guidelines that focus on what is shared across disciplines," Wilson said.

Each of eight standards has three levels of adoption in the TOP guidelines; each moves scientific communication toward greater openness, according to the article in Science. These standards are modular, facilitating adoption in whole or in part. However, they also complement each other; commitment to one standard may facilitate adoption of others.

The standards include citation standards for journals, data transparency, analytic methods (code) transparency, research materials transparency, design and analysis transparency, preregistration of studies, preregistration of analysis plans and replication.

Two standards reward researchers for the time and effort they have spent engaging in open practices. Citation standards extend current article citation norms to data, code and research materials. Regular and rigorous citation of these materials credits them as original intellectual contributions. Replication standards recognize the value of replication for independent verification of research results and identify the conditions under which replication studies will be published in the journal.

Four of the standards describe what openness means across the scientific process so that research can be reproduced and evaluated. Reproducibility increases confidence in findings and also allows scholars to learn more about what results mean. Design standards increase transparency about the research process and reduce vague or incomplete reporting of the methodology. Standards for research materials encourage the provision of all elements of that methodology, and data-sharing standards give authors an incentive to make data available in trusted repositories.

The final two standards address the values resulting from preregistration. Standards for preregistration of studies facilitate the discovery of research, even unpublished research, by ensuring that the existence of the study is recorded in a public registry. Preregistrations of analysis plans certify the distinction between confirmatory and exploratory research, or what is also called hypothesis-testing versus hypothesis-generating research. Making the distinction between confirmatory and exploratory methods transparent can enhance reproducibility.

"The guidelines are sensitive to concerns by both journals and researchers," Wilson said. "For example, we encourage journals to state exceptions to sharing because of ethical issues, intellectual property concerns or availability of necessary resources. We encourage journals to pick and choose among the different levels and standards in order to define what they expect of the researchers.

"We acknowledge the variation in evolving norms about research transparency. Depending on the discipline or publishing format, some of the standards may not be relevant for a journal. Journal and publisher decisions can be based on many factors -- including their readiness to adopt modest to stronger transparency standards for authors, internal journal operations and disciplinary norms and expectations," Wilson said.

The present version of the guidelines is not the last word on standards for openness in science, according to the report. "As with any research enterprise, the available empirical evidence will expand with application and use of these guidelines," the TOP Committee wrote. "To reflect this evolutionary process, the guidelines are accompanied by a version number and will be improved as experience with them accumulates."

An information commons and support team at the Center for Open Science is available (This email address is being protected from spambots. You need JavaScript enabled to view it.) to assist journals in selection and adoption of standards and will track adoption across journals. Adopting journals may also suggest revisions that improve the guidelines or make them more flexible or adaptable for the needs of particular subdisciplines.

To read the complete guidelines, please visit: https://osf.io/ud578/

Most Popular Now

Therapy using dual immune system cells effectively…

A newly developed immunotherapy that simultaneously uses modified immune-fighting cells to home in on and attack two antigens, or foreign substances, on cancer cells was ...

Cleveland Clinic study suggests steroid nasal spra…

A recent Cleveland Clinic study found that patients who regularly use steroid nasal sprays are less likely to develop severe COVID-19-related disease, including a 20 to 2...

How to develop new drugs based on merged datasets

Polymorphs are molecules that have different molecular packing arrangements despite identical chemical compositions. In a recent paper, researchers at GlaxoSmithKline (GS...

New drug combination effective against SARS-CoV-2 …

More countries with greater resources are opening up for a more normal life. But COVID-19 and the SARS-CoV-2 virus are still a significant threat in large parts of the wo...

Sanofi to focus its COVID-19 development efforts o…

Recent positive interim results of Sanofi's mRNA-based COVID-19 vaccine candidate Phase 1/2 study confirm the company's platform robust capabilities and strategy in mRNA...

Discovery of mechanics of drug targets for COVID-1…

A team of international researchers, including McGill Professor Stéphane Laporte, have discovered the working mechanism of potential drug targets for various diseases suc...

Phase II/III trial shows Ronapreve™ (casirivimab a…

Roche (SIX: RO, ROG; OTCQX: RHHBY) today confirmed positive data from the phase II/III 2066 study, investigating Ronapreve™ (casirivimab and imdevimab) in patients hospit...

Pfizer and BioNTech receive first U.S. FDA Emergen…

Pfizer Inc. (NYSE: PFE) and BioNTech SE (Nasdaq: BNTX) announced that the U.S. Food and Drug Administration (FDA) has authorized for emergency use a booster dose of the P...

AZD7442 request for Emergency Use Authorization fo…

AstraZeneca has submitted a request to the US Food and Drug Administration (FDA) for an Emergency Use Authorization (EUA) for AZD7442, its long-acting antibody (LAAB) com...

Pfizer and BioNTech receive CHMP positive opinion …

Pfizer Inc. (NYSE: PFE, "Pfizer") and BioNTech SE (Nasdaq: BNTX, "BioNTech") today announced that the Committee for Medicinal Products for Human Use (CHMP) of the Europea...

Boehringer Ingelheim acquires Abexxa Biologics to …

Boehringer Ingelheim announced the acquisition of Abexxa Biologics Inc., a biopharmaceutical company taking a new approach in the fields of immuno-oncology and oncology r...

GSK welcomes WHO recommendation for broad roll-out…

GlaxoSmithKline (GSK) plc welcomes and applauds the WHO recommendation for the broader deployment of GSK's RTS,S malaria vaccine to reduce childhood illness and deaths fr...