Summary of “NIH Workshop on Optimizing Reproducibility in Nonhuman Primate Research Studies by Enhancing Rigor and Transparency” Now Available

First, I want to take a moment to wish you all well as we collectively weather the unprecedented novel coronavirus pandemic. I hope all readers of this blog, and their loved ones and friends are staying safe and well. As you might imagine, COVID-19 response is occupying a great deal of the bandwidth of NIH right now, as we ensure the safety of our workforce and accelerate scientific solutions to the current crisis. However, even from remote workspaces and amidst the flurry of pandemic response, work to support the ongoing mission of the agency is continuing…

Today, NIH is posting a summary of a workshop held in February which brought together key stakeholders to explore the intersection of optimizing research rigor and research involving non-human primates (NHP). You may recall I blogged about this last fall, and I noted the continuity with other NIH efforts assessing the landscape of NHP research, as well as the agency’s ongoing initiative to enhance research reproducibility through improvements in rigor and transparency. In the interim, a neuroethics working group of the Advisory Committee to the NIH Director (ACD) produced a report in October 2019 “Enabling and Enhancing Neuroscience Advances for Society” which included ethical considerations for NHP research, particularly relative to emerging biotechnologies. Collectively, these presented a terrific backdrop to bring together experts in various scientific disciplines, primatologists, veterinarians, and bioethicists, including representatives from National Primate Research Centers, academic institutions, government, industry and non-profit groups for two days of in-depth discussion.

A number of common themes emerged, including:

  • Ethical considerations should extend beyond legal and regulatory requirements.
  • It is of critical importance to understand the course of human disease and to understand the strengths and limitations of the animal model proposed for use.
  • Rigor and transparency necessitates data sharing yet there are challenges.
  • Rigor, welfare, husbandry, environment, and behavior are all interrelated.
  • Rigorous and reproducible science is part of a virtuous learning cycle.

However, this concise summary gives short shrift to the rich and thoughtful discussion of the unique opportunities and challenges shared by the NHP research community, and I encourage you to read the full report to get a better sense of the full breath of issues discussed. As one participant noted, even the lunchtime conversations represented exciting exchanges of ideas at the nexus of scientific and clinical opportunities, ethical considerations, ensuring rigor and transparency, and the nuances of animal welfare and husbandry. It highlighted how interdisciplinary engagement – from experts in primatology, statisticians, experimental design, clinicians, ethicists, data scientists, and basic biologists – can be incredibly useful to maximize the knowledge generated by working with these critically important animal models. In addition, it became very clear that lessons learned from NHP can more broadly benefit enhancing rigorous study design in all animal research and that data sharing is key for facilitating rigor and reproducibility.

While the discussion itself was important in fostering those connections, a natural question to ask is: what happens next? The proceedings of the workshop feed into the broader efforts of the ACD Working Group on Enhancing Reproducibility and Rigor in Animal Research (of which I am a member) in its deliberations. This group has been charged with assessing and making recommendations to enhance the reproducibility and rigor of animal research by improving experimental design, optimizing translational validity, enhancing training, and increasing the transparency of research studies involving animal models, and is expected to present an interim report to the ACD in June.

‘Twas the Night Before……

‘Twas the night before Christmas, And nobody’s here.

All of us Feds are on break, But please don’t you fear…

The policy gurus, soon will return,

NIH’s midnight oil will not cease to burn.

The NExTRAC working groups are now on their way,

Emerging biotech we need to think on today.

And the Draft Data Policy is finally out,

Waiting for comments, the cheers and the shouts.

The BESH researchers are nestled, snug in their delay,

As we work with them on ensuring results see light of day.

Rumors are flying on the public access front,

We have no comment, if I may be so blunt.

The Common Rule at long last will go into effect,

Genomic Summary Results, you can now freely detect.

Return of results, we’re still thinking deep thoughts,

How to respect research participants, who we care about lots.

We’re thinking about ethics for humans, monkeys, and BRAIN,

That doesn’t mean new policy, is our constant refrain!

And I, in my role as NIH Chief of Staff,

“What work-life balance?”, I’ve been known to laugh.

On sexual harassment, let me be very clear,

Unacceptable, immoral, and not welcome here.

The culture that allows bad behavior to occur,

Is something everyone of us is responsible for.

Science needs to change, NIH needs to drive it,

We must unite with those who have somehow survived it.

“So, on civility, on respect, on diversity and inclusion!

On safe research spaces, down with biased exclusion!

On polices that promote only science that is best,

Rigorous and translatable, when put to the test!”

And when the NSABB convenes in the first quarter of ’20,

Biosecurity and transparency, we’ll talk about plenty!

The NIH Guidelines need a refresh,

And improving clinical trials goes well beyond BESH.

Heritable gene editing is still all the rage,

Will the world’s governance bodies get on the same page?

Policy opportunities abound in the coming New Year!

From all of our stakeholders, we’re dying to hear…

But for now let’s pause, as we rarely do,

To say from NIH OSP, happy holidays to you!

A Quick Word About Human Embryo Model Systems

Rapidly emerging areas of science can pose interesting challenges for policy frameworks intended to provide oversight of biomedical research or statutory limitations on NIH funding. A recent example, as described in this story on NPR, is an area of research in which scientists are hoping to gain insight on human development by creating structures that model certain aspects of embryonic development. The methods used to create these various model systems generally use human pluripotent stem cells, which are then differentiated into cell types with characteristics and/or organization similar to those seen in human embryos.

NIH has had a long-standing statutory limitation on funding research involving human embryos. The limitation, sometimes called the ‘Dickey-Wicker” amendment, is included annually in HHS appropriations language and has been incorporated into the NIH Grants Policy Statement (GPS). The GPS specifies that “NIH funds may not be used for (1) the creation of a human embryo or embryos for research purposes…”

You can probably anticipate the question I usually have to address. Can research involving various models of aspects of human embryo development be supported by NIH? The answer is “it depends.”

As a steward of taxpayer funds, NIH considers, on a case-by-case basis, whether we can support specific research proposals given the limitations set by the NIH GPS. NIH applies the same considerations to both research proposing the use of human embryos and research that aims to create or use experimental systems with human cells that model human embryos. We examine all experimental details specific to that experiment in order to make an informed decision about whether the research could be supported.

It is also important to note that even if NIH were to determine that proposed research is supportable under the limitation–NIH Institutes and Centers consider scientific merit, program priorities, their portfolio balance, and the availability of funds in making final funding decisions.

To help identify and better understand some of the unknowns associated with this nascent field of research, the National Academies of Science, Engineering, and Medicine will be holding a state of the science workshop on mammalian embryo model systems on Friday, January 17, 2020. I am looking forward to hearing more from the experts in the field about the opportunities and challenges that face this type of research.

Related Blog Post: Sharing Our Current Thinking: Models Containing Aspects of Human Embryos

Posted by Dr. Carrie D. Wolinetz, October 10, 2019

Update on the “NIH Workshop on Optimizing Reproducibility in Nonhuman Primate Research Studies by Enhancing Rigor and Transparency”

I’ve received a lot of emails from folks asking why NIH announced and then subsequently postponed the “NIH Workshop on Optimizing Reproducibility in Nonhuman Primate Research Studies by Enhancing Rigor and Transparency.”  With everything going on in this space, NIH decided to pump the brakes on our NHP workshop to make sure we were putting together an agenda that moves the conversation forward and takes advantage of the expertise and groundwork already laid.

Over the past few years, NIH has been bolstering activities and policies focused on enhancing the rigor and reproducibility of the science it funds.  A notable example of this would be the work we have been doing to improve the quality and transparency of clinical trials. As discussed at the June meeting of the Advisory Committee to the NIH Director (ACD), the agency is now turning its attention to identifying gaps and opportunities to improve the rigor, reproducibility, translational validity, and transparency of studies involving animal models.

At that same meeting, NIH Director Francis Collins made it clear that nonhuman primate (NHP) research is essential to the NIH portfolio given the fundamental role it plays in both basic and translational research. In fact, the NIH Office of Research Infrastructure Programs (ORIP) recently released a two-part report on assessing nonhuman primate needs and resources for biomedical research, which projected an increased and unique need for NHP models, particularly in the areas of neuroscience and infectious disease.

While the NIH effort is focused rightfully on all species used in biomedical research, NHP research presents some unique opportunities and challenges. This has long been recognized in the animal welfare arena (for example, the Office of Laboratory Animal Welfare has six species-specific publications on enrichment for NHP) and has been well documented in considerations of scientific justification and oversight.  Moreover, the very qualities that make NHPs the best – and sometimes only – models for the study of human disease and translation of medical advancements also make them the subject of great public interest of which we, as a publicly funded research agency, are cognizant.

To help think through these unique issues, we will be convening a workshop of experts in the field of NHP models to discuss best practices for how these variables are assessed and taken into consideration. This includes thinking through how welfare considerations (such as housing enrichment, long-term care needs, social engagement, etc.) might clarify – or confound – research findings, as well as discussing whether the intersection of cutting-edge science, like neuroscience or gene editing, might present unique ethical considerations for NHP research.

An important thing to keep in mind is that NIH is not alone in thinking about these issues.  The National Academies recently hosted two workshops on the use of NHPs.  The first workshop focused on opportunities afforded by new NHPs models while the second focused on the care, use, and welfare of marmosets involved in gene-editing research. This mirrors the discussions arising in the scientific and bioethics communities about the intersection of NHP research, emerging technologies, and ethical issues.[1] [2] [3] Additionally, recognizing the value of NHP data and the need to share data efficiently, researchers are beginning to self-assemble to promote collaboration and open science. For instance, the PRIMatE Data Exchange is hosting a meeting in the fall at the Wellcome Trust to bring leading investigators from around the world to develop action plans related to activities in the field of NHP imaging. At the end of the day, all of these efforts have a common goal: assuring the best quality science adheres to commonsense ethical standards in order to improve human health.

We look forward to engaging with stakeholders to share best practices, consider new challenges, and offer pathways for improvement if needed. Stay tuned for further information…

[1] Sadato et al. (2019) Neuroethical issues of the Brain/MINDS project of Japan. Neuron, 101:385-389. https://doi.org/10.1016/j.neuron.2019.01.006

[2] Greely et al. (2016) Neuroethics in the age of brain projects. Neuron, 92(3): 637-641. https://doi.org/10.1016/j.neuron.2016.10.048

[3] Johnson, L.S. (2019) Neuroethics of the nonhuman. AJOB Neuroscience, 10(3):111-136. https://www.tandfonline.com/doi/full/10.1080/21507740.2019.1632973?af=R&

Posted by Dr. Carrie D. Wolinetz, September 16, 2019