- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Faculty Research and Publications /
- Validation and refinement of the Stakeholder-driven...
Open Collections
UBC Faculty Research and Publications
Validation and refinement of the Stakeholder-driven Community Diffusion Survey for childhood obesity prevention Korn, Ariella R.; Appel, Julia; Hammond, Ross A.; Hennessy, Erin; Mâsse, Louise C.; Must, Aviva; Economos, Christina D.
Abstract
Background Whole-of-community interventions hold promise in addressing childhood obesity. The COMPACT Stakeholder-driven Community Diffusion theory posits that stakeholders’ knowledge of childhood obesity prevention efforts and engagement with the issue contribute to successful intervention implementation. Building on completed formative research and pilot testing, we describe the validation and refinement of knowledge and engagement measures. Methods We assessed content validity using a modified Delphi process with science (n=18) and practice-based (n=16) experts. Next, we refined the survey based on input from science- and practice-based experts, cognitive response testing, and item analysis of extant survey data. Field testing of the refined survey involved community stakeholders in Greenville County, South Carolina (n=50), East Boston, Massachusetts (n=30), and Tucson, Arizona (n=84) between 2019 and 2020. Construct validity was assessed with confirmatory factor analysis (CFA). Two-week test-retest reliability was assessed among a subsample of 14 paired respondents in South Carolina. Results Experts rated existing knowledge domains (intervention factors, roles, sustainability, problem, resources) and engagement domains (dialogue/mutual learning, flexibility, influence/power, leadership/stewardship, trust) highly for their importance in addressing childhood obesity. Expert input resulted in 11 new knowledge items and 7 new engagement items that mapped onto existing domains. Correspondingly, two domain names were modified: implementation/sustainability and trust/trustworthiness. We also eliminated 8 extant items (4 knowledge and 4 engagement) and adapted item language for comprehension and consistency. Further modifications based on CFA results and item analyses resulted in 23 knowledge items across four domains (roles and resources merged) and 23 engagement items across five domains. Modified knowledge and engagement scales had adequate fit and strong item factor loadings (most >0.7 and all >0.5). Knowledge (α=0.86–0.87) and engagement (α=0.75–0.90) subscales had high internal scale consistency. Knowledge intraclass correlation coefficients (ICCs) for test-retest agreement of subscale scores ranged from 0.50 for intervention factors to 0.86 for roles/resources. For engagement subscale scores, ICCs ranged from 0.70 for trust/trustworthiness to 0.96 for leadership/stewardship. Conclusions Findings from this multi-method survey development process increase our confidence of the knowledge and engagement measures’ content validity, construct validity, and reliability.
Item Metadata
Title |
Validation and refinement of the Stakeholder-driven Community Diffusion Survey for childhood obesity prevention
|
Creator | |
Contributor | |
Publisher |
BioMed Central
|
Date Issued |
2021-10-09
|
Description |
Background
Whole-of-community interventions hold promise in addressing childhood obesity. The COMPACT Stakeholder-driven Community Diffusion theory posits that stakeholders’ knowledge of childhood obesity prevention efforts and engagement with the issue contribute to successful intervention implementation. Building on completed formative research and pilot testing, we describe the validation and refinement of knowledge and engagement measures.
Methods
We assessed content validity using a modified Delphi process with science (n=18) and practice-based (n=16) experts. Next, we refined the survey based on input from science- and practice-based experts, cognitive response testing, and item analysis of extant survey data. Field testing of the refined survey involved community stakeholders in Greenville County, South Carolina (n=50), East Boston, Massachusetts (n=30), and Tucson, Arizona (n=84) between 2019 and 2020. Construct validity was assessed with confirmatory factor analysis (CFA). Two-week test-retest reliability was assessed among a subsample of 14 paired respondents in South Carolina.
Results
Experts rated existing knowledge domains (intervention factors, roles, sustainability, problem, resources) and engagement domains (dialogue/mutual learning, flexibility, influence/power, leadership/stewardship, trust) highly for their importance in addressing childhood obesity. Expert input resulted in 11 new knowledge items and 7 new engagement items that mapped onto existing domains. Correspondingly, two domain names were modified: implementation/sustainability and trust/trustworthiness. We also eliminated 8 extant items (4 knowledge and 4 engagement) and adapted item language for comprehension and consistency. Further modifications based on CFA results and item analyses resulted in 23 knowledge items across four domains (roles and resources merged) and 23 engagement items across five domains. Modified knowledge and engagement scales had adequate fit and strong item factor loadings (most >0.7 and all >0.5). Knowledge (α=0.86–0.87) and engagement (α=0.75–0.90) subscales had high internal scale consistency. Knowledge intraclass correlation coefficients (ICCs) for test-retest agreement of subscale scores ranged from 0.50 for intervention factors to 0.86 for roles/resources. For engagement subscale scores, ICCs ranged from 0.70 for trust/trustworthiness to 0.96 for leadership/stewardship.
Conclusions
Findings from this multi-method survey development process increase our confidence of the knowledge and engagement measures’ content validity, construct validity, and reliability.
|
Subject | |
Genre | |
Type | |
Language |
eng
|
Date Available |
2021-11-09
|
Provider |
Vancouver : University of British Columbia Library
|
Rights |
Attribution 4.0 International (CC BY 4.0)
|
DOI |
10.14288/1.0403346
|
URI | |
Affiliation | |
Citation |
Implementation Science. 2021 Oct 09;16(1):91
|
Publisher DOI |
10.1186/s13012-021-01158-4
|
Peer Review Status |
Reviewed
|
Scholarly Level |
Faculty; Researcher
|
Copyright Holder |
The Author(s)
|
Rights URI | |
Aggregated Source Repository |
DSpace
|
Item Media
Item Citations and Data
Rights
Attribution 4.0 International (CC BY 4.0)