swinburn-developmentandtesting-2018.pdf (1.69 MB)
Development and testing of a novel survey to assess stakeholder-driven community diffusion of childhood obesity prevention efforts
journal contribution
posted on 2018-05-31, 00:00 authored by Ariella R Korn, Erin Hennessy, Ross A Hammond, Steven AllenderSteven Allender, Matthew W Gillman, Matt Kasman, Jaimie McGlashan, Lynne Millar, Brynle Owen, Mark C Pachucki, Boyd SwinburnBoyd Swinburn, Alison Tovar, Christina D EconomosBACKGROUND: Involving groups of community stakeholders (e.g., steering committees) to lead community-wide health interventions appears to support multiple outcomes ranging from policy and systems change to individual biology. While numerous tools are available to measure stakeholder characteristics, many lack detail on reliability and validity, are not context specific, and may not be sensitive enough to capture change over time. This study describes the development and reliability of a novel survey to measure Stakeholder-driven Community Diffusion via assessment of stakeholders' social networks, knowledge, and engagement about childhood obesity prevention. METHODS: This study was completed in three phases. Phase 1 included conceptualization and online survey development through literature reviews and expert input. Phase 2 included a retrospective study with stakeholders from two completed whole-of-community interventions. Between May-October 2015, 21 stakeholders from the Shape Up Somerville and Romp & Chomp interventions recalled their social networks, knowledge, and engagement pre-post intervention. We also assessed one-week test-retest reliability of knowledge and engagement survey modules among Shape Up Somerville respondents. Phase 3 included survey modifications and a second prospective reliability assessment. Test-retest reliability was assessed in May 2016 among 13 stakeholders involved in ongoing interventions in Victoria, Australia. RESULTS: In Phase 1, we developed a survey with 7, 20 and 50 items for the social networks, knowledge, and engagement survey modules, respectively. In the Phase 2 retrospective study, Shape Up Somerville and Romp & Chomp networks included 99 and 54 individuals. Pre-post Shape Up Somerville and Romp & Chomp mean knowledge scores increased by 3.5 points (95% CI: 0.35-6.72) and (- 0.42-7.42). Engagement scores did not change significantly (Shape Up Somerville: 1.1 points (- 0.55-2.73); Romp & Chomp: 0.7 points (- 0.43-1.73)). Intraclass correlation coefficients (ICCs) for knowledge and engagement were 0.88 (0.67-0.97) and 0.97 (0.89-0.99). In Phase 3, the modified knowledge and engagement survey modules included 18 and 25 items, respectively. Knowledge and engagement ICCs were 0.84 (0.62-0.95) and 0.58 (0.23-0.86). CONCLUSIONS: The survey measures upstream stakeholder properties-social networks, knowledge, and engagement-with good test-retest reliability. Future research related to Stakeholder-driven Community Diffusion should focus on prospective change and survey validation for intervention effectiveness.
History
Journal
BMC public healthVolume
18Article number
681Pagination
1 - 11Publisher
BioMed CentralLocation
London, Eng.Publisher DOI
Link to full text
eISSN
1471-2458Language
engPublication classification
C1 Refereed article in a scholarly journal; C Journal articleCopyright notice
2018, The AuthorsUsage metrics
Keywords
Childhood obesity preventionCommunity engagementCommunity-based interventionsSurvey developmentScience & TechnologyLife Sciences & BiomedicinePublic, Environmental & Occupational HealthPARTICIPATORY RESEARCHCOMPLEX INTERVENTIONSSYSTEMS SCIENCEHEALTH EQUITYWEIGHT-GAINCAPACITYNETWORKSWHOLEMETAANALYSISCHALLENGESInformation Systems