Jennie Spotila: NIH's management of conflict of interest

Share on facebook
Share on twitter
Share on email

EDITOR’S NOTE: This reporting is written by Jennie Spotila
Next week, the NIH will convene a peer review panel to evaluate and score the applications submitted under the Data Center and Collaborative Research Center RFAs. NIH’s management of conflict of interest is key to understanding who is – and who is not – on the panel.
Peer review is an essential step in NIH’s funding decisions. Subject matter experts are appointed to review grant proposals, and provide NIH with an assessment of the quality of each one. Frequently, the subject matter experts have connections to the researchers applying for funding, and that is where the conflict of interest policy comes in to play.
If you look at the roster for the RFA review panel, you will probably notice a couple things. First, many of the biggest names in ME research are missing. No Cook, Davis, Hanson, Hornig, Jason, Klimas, Lipkin, Montoya, Younger, etc. That’s because these researchers are reportedly among those who submitted funding applications.
NIH’s conflict of interest policy prohibits an individual from serving on a review panel if he/she has a “major professional role” on one of the applications. Why? Because an applicant for funding wants to succeed, and should not be in a position where they can influence that outcome. The personal interest of succeeding is in conflict with a grant reviewer’s ethical obligation to evaluate all applications fairly.
There is another conflict of interest restriction at NIH, called the “out of room” conflict of interest. In this situation, a grant reviewer can serve on the panel, but has to leave the room when a specific application is discussed because of a potential (or even the appearance of) conflict of interest.
An “out of room” conflict of interest can arise in a number of specific circumstances, including:

  • A person with a major professional role on an application is from the reviewer’s institution
  • The reviewer has collaborated or published in the last three years with a person with a major role on an application
  • The reviewer provided a letter of support for an application

Any close professional relationship can create the appearance of a conflict of interest, such as between a PhD advisor and doctoral student. In these and other similar cases, the reviewer in question must leave the room before the application is discussed. However, the reviewer can still participate in scoring the other applications at the same meeting.
This is where things get complicated for the ME review panel at the end of July. Multiple members of the panel overlap with applicants in publications and collaborations (some outside that three-year window), and one is from the same institution as one of the applicants.
Stringent enforcement of the conflict of interest policy is important to NIH, according to Dr. Richard Nakamura, Director of the NIH Center for Scientific Review. He says, “Reviewers are regularly reminded of their legal and ethical responsibilities to identify potential conflicts of interest.  Our Scientific Review Officers spell out COI policy in pre-meeting briefings and at the beginning of every review meeting. Our Internet Assisted Review system forces them to declare whether they have a conflict before and after the meeting.  This system also notifies our Scientific Review Officers when it identifies potential conflicts. Nonetheless, any knowledge of a field or the researchers in it means that there could always be some biases, so we must be vigilant and our goal is to manage conflicts so they are minimized.”
The burden of enforcing this policy falls on both the Scientific Review Officers and the grant reviewers. In any field, the web of professional relationships can be quite complicated, and Review Officers may not be able to identify each potential conflict. This is especially true when there is a large panel, such as the twenty-six members of the RFA panel this month. Grant reviewers have an ethical obligation to self-identify when they have a potential conflict of interest, as well.
Is it problematic to allow the “out of room” conflicted reviewers to participate in the remainder of the meeting? What prevents a reviewer from tanking competitors’ applications, or supporting others? Dr. Nakamura says, “Our Scientific Review Officers and study section chairs are trained to identify instances where a single reviewer is out of step with the others, and the group will be driven to discuss the reasons driving the different scores.  In addition, reviewers are encouraged to speak up if they see another reviewer attempt to skew a review.”

There is a great deal at stake next week. The RFA represents the largest single investment in ME research in the last decade.

NIH does not publicly disclose the outcome of any conflict of interest discussion, so we won’t know if any of the ME experts on the review panel will be required to leave the room during discussion of a specific application. We also will have no transparency into the fairness of the scoring and reviewing process, and whether there was positive or negative bias at play.
Peer review is not the only step in NIH funding decisions. After scoring by the peer review panel, program staff evaluate and present a grant funding plan to the Institute Council. The Council makes their own recommendations, and the Institute Director makes the final funding decisions. An unfair advantage given to a grant application in the peer review stage does not automatically mean it will be funded.
It is important to remember that the integrity of the peer review process is critical for NIH. Researchers may complain about scoring and the quality of peer review, but for the system to work there must be general trust in the fairness of the process. A specific application may not get funded, but every application deserves an equally fair shot.  Disease communities, especially one that has been as historically underfunded as ME, also depend on the fairness of peer review in order to ensure that the best research ideas are funded.
There is a great deal at stake next week. The RFA represents the largest single investment in ME research in the last decade. Ten different groups applied for the two or three research center grants. There is a great deal of pressure on the peer review panel  – and on NIH – to get this process right. The public should expect rigorous and fair peer review that succeeds in identifying the best grants for funding.
 

Share on facebook
Facebook
Share on twitter
Twitter
Share on whatsapp
WhatsApp
Share on email
Email

4 thoughts on “Jennie Spotila: NIH's management of conflict of interest”

  1. Lara Henderson

    Great explanation Ben! We had similar confluct of interest rules as CPAs, Independent auditing etc..even just the appearance of a conflict prevented ud from providing services to certain clients. Its part of our code of ethics under thr AICPA and State CPA societies. Thank you got the awesome article! This stuff is difficult to explain to the public and thus was very thorough!
    As always, Thank you for just being you and all you do!
    Highest Regards,
    Lara

  2. Oh it says by Jennie at the top but by Ben in the center. A bit confusing..thank you both!
    Ben/Adrianne could you maybe introduce the new Managing Director formally yo us in the groups?
    🦋💜
    Lara

  3. Is this for a total of $6 million? $1.2 million/year max per team? Duration for each research team 5 years max?

Leave a Comment

Your email address will not be published. Required fields are marked *

Latest News

Press Jungle Featured Image

#MEAction Swinging Through The Press Jungle

Welcome to the jungle, the press jungle! It’s hot and noisy here, with news fresh off the press. Trying to get the attention of the media is not as impossible as legend had it! This is Adriane, and as your Press Scribe, I’m here to write our way through this next adventure and make sure

Read More »
Research Lagoon

#MEAction Swimming Through the Research Lagoon

Hi, everyone! It’s Jaime, the Director of Scientific & Medical Outreach at #MEAction. During this week’s #MEAction Giving Adventure we swam through the Research Lagoon as we surpassed our second fundraising level of US $20,000/UK£14,820. While our fundraising format this year is fun and lighthearted, the work #MEAction is doing to advance research and clinical

Read More »

Join over 1,000 people and vote for your ME/CFS research priorities

Over 1,000 people have now voted for their ME/CFS research priorities. People with ME/CFS, carers and clinicians in the UK are all asked to take part. The ME/CFS Priority Setting Partnership is particularly looking for more people from ethnic minorities, carers and health care professionals to take part. So far: Just 4% of respondents are

Read More »

Help keep our work going

We rely on donations from people like you to keep fighting for equality for people with ME.

Donate

Get actions alerts and news direct to your inbox

You can choose what you want to be kept up to date on.

Subscribe
Scroll to Top