Developing evaluation metrics to measure the US national institute of health plans to enhance diverse perspectives: a protocol for a consensus-based study

Introduction The diversity of participating investigators representing diverse disciplines, career stages, stakeholder groups, regions and types of institutions is essential for the success of large-scale research programmes. In 2021, the National Institutes of Health introduced a requirement for some of its large grants to include a separate section that describes the project’s plan for enhancing diverse perspectives (PEDPs). Our project aims to develop consensus-based PEDP evaluation metrics and instruments that can be systematically and sustainably collected across the projects. Methods and analysis Evaluation work is organised into three objectives. First, shared knowledge about PEDP infrastructures, activities and outcomes will be elicited through the review of the PEDP texts of funded projects, with 15 as the target sample size. Data will be analysed using a cultural domain analysis approach and assessed for recurrence and salience of PEDP metrics. Second, consensus-based evaluation metrics will be developed using a three-round Delphi method. The descriptive statistics (mean, SD and IQR) and cultural consensus analyses will be applied to the first and last rounds of the Delphi survey. Third, metrics will be piloted for implementation and validation within one of the Human BioMolecular Atlas Programme sites. Work will be completed by Fall 2025. Ethics and dissemination The long-term goal of the effort reported in this paper is to develop PEDP common metrics that are generalisable and feasible across diverse projects. This rigorous, focused evaluation development effort aims to inform scientific practices and policies around implementing the plans to enhance diverse perspectives.