Jennie Spotila: NIH's management of conflict of interest

EDITOR’S NOTE: This reporting is written by Jennie Spotila
Next week, the NIH will convene a peer review panel to evaluate and score the applications submitted under the Data Center and Collaborative Research Center RFAs. NIH’s management of conflict of interest is key to understanding who is – and who is not – on the panel.
Peer review is an essential step in NIH’s funding decisions. Subject matter experts are appointed to review grant proposals, and provide NIH with an assessment of the quality of each one. Frequently, the subject matter experts have connections to the researchers applying for funding, and that is where the conflict of interest policy comes in to play.
If you look at the roster for the RFA review panel, you will probably notice a couple things. First, many of the biggest names in ME research are missing. No Cook, Davis, Hanson, Hornig, Jason, Klimas, Lipkin, Montoya, Younger, etc. That’s because these researchers are reportedly among those who submitted funding applications.
NIH’s conflict of interest policy prohibits an individual from serving on a review panel if he/she has a “major professional role” on one of the applications. Why? Because an applicant for funding wants to succeed, and should not be in a position where they can influence that outcome. The personal interest of succeeding is in conflict with a grant reviewer’s ethical obligation to evaluate all applications fairly.
There is another conflict of interest restriction at NIH, called the “out of room” conflict of interest. In this situation, a grant reviewer can serve on the panel, but has to leave the room when a specific application is discussed because of a potential (or even the appearance of) conflict of interest.
An “out of room” conflict of interest can arise in a number of specific circumstances, including:

  • A person with a major professional role on an application is from the reviewer’s institution
  • The reviewer has collaborated or published in the last three years with a person with a major role on an application
  • The reviewer provided a letter of support for an application

Any close professional relationship can create the appearance of a conflict of interest, such as between a PhD advisor and doctoral student. In these and other similar cases, the reviewer in question must leave the room before the application is discussed. However, the reviewer can still participate in scoring the other applications at the same meeting.
This is where things get complicated for the ME review panel at the end of July. Multiple members of the panel overlap with applicants in publications and collaborations (some outside that three-year window), and one is from the same institution as one of the applicants.
Stringent enforcement of the conflict of interest policy is important to NIH, according to Dr. Richard Nakamura, Director of the NIH Center for Scientific Review. He says, “Reviewers are regularly reminded of their legal and ethical responsibilities to identify potential conflicts of interest.  Our Scientific Review Officers spell out COI policy in pre-meeting briefings and at the beginning of every review meeting. Our Internet Assisted Review system forces them to declare whether they have a conflict before and after the meeting.  This system also notifies our Scientific Review Officers when it identifies potential conflicts. Nonetheless, any knowledge of a field or the researchers in it means that there could always be some biases, so we must be vigilant and our goal is to manage conflicts so they are minimized.”
The burden of enforcing this policy falls on both the Scientific Review Officers and the grant reviewers. In any field, the web of professional relationships can be quite complicated, and Review Officers may not be able to identify each potential conflict. This is especially true when there is a large panel, such as the twenty-six members of the RFA panel this month. Grant reviewers have an ethical obligation to self-identify when they have a potential conflict of interest, as well.
Is it problematic to allow the “out of room” conflicted reviewers to participate in the remainder of the meeting? What prevents a reviewer from tanking competitors’ applications, or supporting others? Dr. Nakamura says, “Our Scientific Review Officers and study section chairs are trained to identify instances where a single reviewer is out of step with the others, and the group will be driven to discuss the reasons driving the different scores.  In addition, reviewers are encouraged to speak up if they see another reviewer attempt to skew a review.”

There is a great deal at stake next week. The RFA represents the largest single investment in ME research in the last decade.

NIH does not publicly disclose the outcome of any conflict of interest discussion, so we won’t know if any of the ME experts on the review panel will be required to leave the room during discussion of a specific application. We also will have no transparency into the fairness of the scoring and reviewing process, and whether there was positive or negative bias at play.
Peer review is not the only step in NIH funding decisions. After scoring by the peer review panel, program staff evaluate and present a grant funding plan to the Institute Council. The Council makes their own recommendations, and the Institute Director makes the final funding decisions. An unfair advantage given to a grant application in the peer review stage does not automatically mean it will be funded.
It is important to remember that the integrity of the peer review process is critical for NIH. Researchers may complain about scoring and the quality of peer review, but for the system to work there must be general trust in the fairness of the process. A specific application may not get funded, but every application deserves an equally fair shot.  Disease communities, especially one that has been as historically underfunded as ME, also depend on the fairness of peer review in order to ensure that the best research ideas are funded.
There is a great deal at stake next week. The RFA represents the largest single investment in ME research in the last decade. Ten different groups applied for the two or three research center grants. There is a great deal of pressure on the peer review panel  – and on NIH – to get this process right. The public should expect rigorous and fair peer review that succeeds in identifying the best grants for funding.
 

Facebook
Twitter
WhatsApp
Email

4 thoughts on “Jennie Spotila: NIH's management of conflict of interest”

  1. Lara Henderson

    Great explanation Ben! We had similar confluct of interest rules as CPAs, Independent auditing etc..even just the appearance of a conflict prevented ud from providing services to certain clients. Its part of our code of ethics under thr AICPA and State CPA societies. Thank you got the awesome article! This stuff is difficult to explain to the public and thus was very thorough!
    As always, Thank you for just being you and all you do!
    Highest Regards,
    Lara

  2. Oh it says by Jennie at the top but by Ben in the center. A bit confusing..thank you both!
    Ben/Adrianne could you maybe introduce the new Managing Director formally yo us in the groups?
    🦋💜
    Lara

  3. Is this for a total of $6 million? $1.2 million/year max per team? Duration for each research team 5 years max?

Comments are closed.

Latest News

Blue square image with starbursts in the corners. the words, submit long covid drug recommendations to recover -tlc! are in the middle of the image, surrounded by thin white lines. the meaction logo is at the top of the image.

Submit Long COVID Drug Recommendations to RECOVER-TLC!

Last month, RECOVER TLC met at NIH headquarters in Bethesda. The goal was to initiate a drug development strategy for Long COVID clinical trials. Now, RECOVER TLC has opened the RECOVER-TLC Intervention Information Request Form, where you can make suggestions about which drugs and other interventions to trial!  Anyone can submit a therapeutic for consideration

Read More »
A classroom of people watching a panel discussion.

The RECOVER-Treating Long COVID (RECOVER TLC) The Path Forward

The RECOVER-Treating Long COVID (RECOVER TLC) Kick-off Meeting was Sept 23-25 in person and over Zoom. I had the privilege of attending over Zoom and Jaime Seltzer, #MEAction’s Scientific Director, represented the needs of the ME community in person and as an invited member of a panel on clinical trial design. There were many speakers

Read More »
greyish rectangle image with the words: #MEAction is Excited to Announce: Pillow Writers Anthology Issue 1: Near-Life Experiences. In a small grey square the words Get Your Copy Today! with a black line underneath. On the right hand side of the square is the image of the book cover that has a water color of flowers. the #meaction logo is at the bottom of the image.

Pillow Writers Anthology, Issue 1: Near-Life Experiences Available Now!

The Pillow Writers Anthology, Issue 1: Near- Life Experiences is a new literary magazine in the disability community. This inaugural issue features poems, stories, and essays by 17 writers who call themselves the Pillow Writers. The Pillow Writers are an international group of writers living with the neuro-immune diseases of myalgic encephalomyelitis (ME) and Long

Read More »
Scroll to Top