Development and preliminary evaluation of the Implementation Research Proposal Appraisal Criteria (ImpResPAC) tool: an international expert modified e-Delphi study
Implementation Science Communications 2026 Open access
Authors:
Louise Hull, Chloe Sweetnam, Rachel E Davis, Zarnie Khadjesari, Andy Healey, Annette Boaz, Ioannis Bakolis, Nick Sevdalis, Lucy Goulding, ImpResPAC Expert Advisory Panel, Sara Ackerman, Prajakta Adsul
+65 more
Miya L. Barnett, Barbara M Barrett, Anna Bergström, Sarah A. Birken, Sabah Boufkhed, Louise Brown, Adithya Cattamanchi, Caroline Sarah Clarke, Tara Clinton‐McHarg, Peter Craig, Geoffrey Curran, Alex R. Dopp, Alicia G. Dugan, Jacquelyn S. Favours, Tracy L Finch, Signe Agnes Flottorp, Robbie Foy, Hannah E. Frank, Kara A. Gray‐Burrows, Claudia Hanson, Ties Hoomans, Elaine C. Khoong, Roman Kislov, Rebecca Lawton, Jennifer Leeman, Rebecca Lengnick‐Hall, Moira McNulty, Sara Malone, Graham Paul Martin, Ruben G. Martinez, Allison J. R. Metz, Aaloke Mody, Joanna C. Moullin, Janet Myers, Per Nilsen, Kathryn A. Oliver, Dennis Pérez, Lisa Maria Pfadenhauer, Hilary Pinnock, Sebastian Potthoff, Byron Powell, Borsika Adrienn Rabin, Angus I. G. Ramsay, Jamie Ross, Alex Rowe, Lisa Saldana, Jane K. Sandall, Joanna Schellenberg, Kelli Scott, Kate Seers, Christopher Shea, Justin D. Smith, Matthew A. Spinelli, Nicole A. Stadnick, Taren Swindle, Carolyn Tarrant, Silia Vitoratou, Thomas J. Waltz, Michel Wensing, Michelle C. White, Cathleen Elizabeth Willging, Til Wykes, Brian Yates, Serene Yoong, Alexandra Ziemann
Cited by:
0
References:
29
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT
Free to try with your Science Catalogs account.
Abstract
BACKGROUND: High-quality implementation research is fundamental to increasing the uptake of evidence-based interventions in healthcare and ultimately improving healthcare delivery and outcomes. However, the development of high-quality implementation research proposals and the identification of the 'best' implementation research proposals to fund are hampered by the lack of criteria for their appraisal. This study describes the development and evaluation of the Implementation Research Proposal Appraisal Criteria (ImpResPAC), a comprehensive tool developed to help research teams identify strengths and weaknesses of their implementation research proposals and provide grant reviewers with clear criteria for appraising the conceptual and methodological quality of implementation research proposals. METHODS: A two-stage sequential mixed-methods design, including content development (stage 1) and a two-round modified e-Delphi (stage 2a & 2b), was employed. Stage 1: Informed by the structure and content of the Implementation Science Research Development (ImpRes) tool and supplementary guide, and a previous study in which five of the ten ImpRes domains were operationalised to develop five ImpResPAC domains, the ImpResPAC development team developed the initial content of ImpResPAC. Purposive and snowball sampling was used to recruit an Expert Advisory Panel (EAP), of individuals that have made a significant contribution to the conceptual and methodological advancement of implementation science. Stage 2a: The EAP provided feedback on ImpResPAC. Based on the feedback, the ImpResPAC development team made extensive revisions to ImpResPAC. Stage 2b: The refined ImpResPAC was shared with the EAP for further feedback and evaluation. RESULTS: Sixty-eight international experts formed the EAP. ImpResPAC includes 71 domain items, each indicative of high-quality implementation research. The domain items are organised over 10 domains each representing a core element of implementation research. Based on feedback, user instructions were refined, and a glossary of terms used in ImpResPAC was developed. CONCLUSION: ImpResPAC is a comprehensive and transparent quantitative tool to appraise the conceptual and methodological quality of implementation research proposals in healthcare. Application of ImpResPAC has several potential and immediate benefits; it will support research teams identify strengths and weaknesses of their implementation research proposals and in turn develop high-quality proposals, enable grant reviewers to identify the 'best' implementation research proposals to fund, and provide a comprehensive tool to be used by educators to appraise implementation research proposals submitted as part of implementation science teaching and training initiatives.
Fields of Study & Subjects
Health Policy Implementation Science
Delphi Technique in Research
Health Sciences Research and Education
Publication details
- Journal / source
- Implementation Science Communications
- Volume
- 7
- Issue
- 1
- Publication date
- 26 March 2026
- Language
- EN