Open Collections

UBC Faculty Research and Publications

Acceptability of an Online Modified-Delphi Panel Approach for Developing Health Services Performance Measures : Results from Three Panels on Arthritis Research Khodyakov, Dmitry; Grant, Sean; Barber, Claire; Marshall, Deborah; Esdaile, John; Lacaille, Diane

Abstract

Rationale, aims, and objectives: Online modified-Delphi (OMD) panel approaches can be used to engage large and diverse groups of clinical experts and stakeholders in developing health services performance measures. Such approaches are increasing in popularity among health researchers. However, information about their acceptability to participating experts and stakeholders is lacking but important to determine before recommending widespread use of online approaches. Therefore, the objective of this paper is to explore acceptability of the OMD panel approach from the participants' perspective. Method: We use data from participants in three OMD panels designed to develop performance measures for use in arthritis research and quality improvement efforts. At the end of each online panel, we surveyed clinical experts and stakeholders who shared their experiences with the OMD process by answering 13 close-ended questions using 7-point Likert-type scales. A mean of 5 or higher on a given question was treated as an indication of acceptability. Results: Ninety-eight clinical experts and stakeholders (92% participation rate) answered survey questions about the online process. They considered the OMD panel approach to be acceptable, particularly the ease of using the online system (mean=5.3, standard deviation=1.3) and the understanding gained from online discussions (mean=5.2, standard deviation=1.0). Participants also felt that participation in the Delphi study was interesting (mean=5.6, standard deviation=1.1). Conclusion(s): These findings illustrate likely acceptability and a potential for a more widespread use of OMD panel approaches by stakeholders in developing health services performance measures.

Item Metadata

Title
Acceptability of an Online Modified-Delphi Panel Approach for Developing Health Services Performance Measures : Results from Three Panels on Arthritis Research
Creator
Khodyakov, Dmitry; Grant, Sean; Barber, Claire; Marshall, Deborah; Esdaile, John; Lacaille, Diane
Date Issued
2016
Description
Rationale, aims, and objectives: Online modified-Delphi (OMD) panel approaches can be used to engage large and diverse groups of clinical experts and stakeholders in developing health services performance measures. Such approaches are increasing in popularity among health researchers. However, information about their acceptability to participating experts and stakeholders is lacking but important to determine before recommending widespread use of online approaches. Therefore, the objective of this paper is to explore acceptability of the OMD panel approach from the participants' perspective. Method: We use data from participants in three OMD panels designed to develop performance measures for use in arthritis research and quality improvement efforts. At the end of each online panel, we surveyed clinical experts and stakeholders who shared their experiences with the OMD process by answering 13 close-ended questions using 7-point Likert-type scales. A mean of 5 or higher on a given question was treated as an indication of acceptability. Results: Ninety-eight clinical experts and stakeholders (92% participation rate) answered survey questions about the online process. They considered the OMD panel approach to be acceptable, particularly the ease of using the online system (mean=5.3, standard deviation=1.3) and the understanding gained from online discussions (mean=5.2, standard deviation=1.0). Participants also felt that participation in the Delphi study was interesting (mean=5.6, standard deviation=1.1). Conclusion(s): These findings illustrate likely acceptability and a potential for a more widespread use of OMD panel approaches by stakeholders in developing health services performance measures.
Subject
Health services research; Healthcare
Genre
Article; Postprint
Type
Text
Language
eng
Date Available
2018-07-18
Provider
Vancouver : University of British Columbia Library
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
DOI
10.14288/1.0368975
URI
http://hdl.handle.net/2429/66524
Affiliation
Medicine, Faculty of; Non UBC; Population and Public Health (SPPH), School of
Citation
Khodyakov, D., Grant, S., Barber, C. E. H., Marshall, D. A., Esdaile, J. M., & Lacaille, D. (2017). Acceptability of an online modified delphi panel approach for developing health services performance measures: Results from 3 panels on arthritis research. Journal of Evaluation in Clinical Practice, 23(2), 354-360.
Publisher DOI
10.1111/jep.12623
Peer Review Status
Reviewed
Scholarly Level
Faculty
Rights URI
http://creativecommons.org/licenses/by-nc-nd/4.0/
Aggregated Source Repository
DSpace

Item Media

Item Citations and Data

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International