Development and evaluation of a train-the-trainer workshop for hong kong community social service agency staff

Qianling Zhou, Sunita M. Stewart, Alice Wan, Charles Sai Cheong Leung, Agnes Y. Lai, Tai Hing Lam, Sophia Siu Chee Chan

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Introduction: Capacity building approaches are useful in large-scale community-based health promotion interventions. However, models to guide and evaluate capacity building among social service agency staff in community settings are rare in the literature. This paper describes the development and evaluation of a 1-day (7 h) train-the-trainer (TTT) workshop for the "Enhancing Family Well-Being Project". The workshop aimed at equipping staff from different community agencies with the knowledge and skills to design, implement, and evaluate positive psychology-based interventions for their clients in Sham Shui Po, an over-crowded and low-income district in Hong Kong. Methods: The current TTT extended and improved on our previous successful model by adding research and evaluation methods (including the Logic Model, process evaluation, and randomized controlled trial), which are important to plan and evaluate the community interventions. Evaluation of the TTT was guided by the Integrated Model of Training Evaluation and Effectiveness (IMTEE), with quantitative and qualitative methods. Quantitative data were collected from pretraining (T1), post-training (T2), and 6-month (T3) and 12-month (T4) follow-up surveys. Qualitative data were collected from four focus groups of agency staff after the intervention. Results: Ninety-three staff from 30 community agencies attended the training, and 90 completed the baseline survey. Eighty-eight, 63, and 57 staff performed the evaluations at T2, T3, and T4, respectively. Agency staff were satisfied with the TTT. Immediate enhancement of knowledge, self-efficacy, and positive attitudes toward the training content was found at T2 (Cohen's d ranged from 0.24 to 1.22, all p < 0.05). Enhancement of knowledge of all training contents persisted at T3 and T4 (Cohen's d ranged from 0.34 to 0.63, all p < 0.05). Enhancement of self-efficacy in the use of positive psychology in intervention design persisted at T3 (Cohen's d = 0.22, p = 0.04). The skills learned were utilized to plan and develop subsequent interventions. Twenty-nine interventions were successfully designed and implemented by the agency staff, and delivered to 1,586 participants. The agency staff indicated their intention to utilize the skills they had learned for other interventions (score =4 out of 6) and to share these skills with their colleagues. Qualitative feedbacks from 23 agency staff supported the quantitative results. Conclusion: Our brief TTT was effectively delivered to a large number of agency staff and showed effects that persisted up to 12 months. Our training and evaluation models may offer a template for capacity building among social service agency staff for community brief, universal family health promotion interventions in diverse settings.

Original languageEnglish (US)
Article number15
JournalFrontiers in Public Health
Volume5
Issue numberFEB
DOIs
StatePublished - Feb 13 2017

Fingerprint

Social Welfare
Hong Kong
Social Work
Education
Capacity Building
Self Efficacy
Health Promotion
Psychology
Family Health
Focus Groups
Randomized Controlled Trials

Keywords

  • Capacity building
  • Community-based intervention
  • Positive psychology
  • Social service agency staff
  • Social work
  • Train-the-trainer
  • Training evaluation

ASJC Scopus subject areas

  • Public Health, Environmental and Occupational Health

Cite this

Development and evaluation of a train-the-trainer workshop for hong kong community social service agency staff. / Zhou, Qianling; Stewart, Sunita M.; Wan, Alice; Leung, Charles Sai Cheong; Lai, Agnes Y.; Lam, Tai Hing; Chan, Sophia Siu Chee.

In: Frontiers in Public Health, Vol. 5, No. FEB, 15, 13.02.2017.

Research output: Contribution to journalArticle

Zhou, Qianling ; Stewart, Sunita M. ; Wan, Alice ; Leung, Charles Sai Cheong ; Lai, Agnes Y. ; Lam, Tai Hing ; Chan, Sophia Siu Chee. / Development and evaluation of a train-the-trainer workshop for hong kong community social service agency staff. In: Frontiers in Public Health. 2017 ; Vol. 5, No. FEB.
@article{6c56518e8fbf4ec9b5dcdd4f4fce2a01,
title = "Development and evaluation of a train-the-trainer workshop for hong kong community social service agency staff",
abstract = "Introduction: Capacity building approaches are useful in large-scale community-based health promotion interventions. However, models to guide and evaluate capacity building among social service agency staff in community settings are rare in the literature. This paper describes the development and evaluation of a 1-day (7 h) train-the-trainer (TTT) workshop for the {"}Enhancing Family Well-Being Project{"}. The workshop aimed at equipping staff from different community agencies with the knowledge and skills to design, implement, and evaluate positive psychology-based interventions for their clients in Sham Shui Po, an over-crowded and low-income district in Hong Kong. Methods: The current TTT extended and improved on our previous successful model by adding research and evaluation methods (including the Logic Model, process evaluation, and randomized controlled trial), which are important to plan and evaluate the community interventions. Evaluation of the TTT was guided by the Integrated Model of Training Evaluation and Effectiveness (IMTEE), with quantitative and qualitative methods. Quantitative data were collected from pretraining (T1), post-training (T2), and 6-month (T3) and 12-month (T4) follow-up surveys. Qualitative data were collected from four focus groups of agency staff after the intervention. Results: Ninety-three staff from 30 community agencies attended the training, and 90 completed the baseline survey. Eighty-eight, 63, and 57 staff performed the evaluations at T2, T3, and T4, respectively. Agency staff were satisfied with the TTT. Immediate enhancement of knowledge, self-efficacy, and positive attitudes toward the training content was found at T2 (Cohen's d ranged from 0.24 to 1.22, all p < 0.05). Enhancement of knowledge of all training contents persisted at T3 and T4 (Cohen's d ranged from 0.34 to 0.63, all p < 0.05). Enhancement of self-efficacy in the use of positive psychology in intervention design persisted at T3 (Cohen's d = 0.22, p = 0.04). The skills learned were utilized to plan and develop subsequent interventions. Twenty-nine interventions were successfully designed and implemented by the agency staff, and delivered to 1,586 participants. The agency staff indicated their intention to utilize the skills they had learned for other interventions (score =4 out of 6) and to share these skills with their colleagues. Qualitative feedbacks from 23 agency staff supported the quantitative results. Conclusion: Our brief TTT was effectively delivered to a large number of agency staff and showed effects that persisted up to 12 months. Our training and evaluation models may offer a template for capacity building among social service agency staff for community brief, universal family health promotion interventions in diverse settings.",
keywords = "Capacity building, Community-based intervention, Positive psychology, Social service agency staff, Social work, Train-the-trainer, Training evaluation",
author = "Qianling Zhou and Stewart, {Sunita M.} and Alice Wan and Leung, {Charles Sai Cheong} and Lai, {Agnes Y.} and Lam, {Tai Hing} and Chan, {Sophia Siu Chee}",
year = "2017",
month = "2",
day = "13",
doi = "10.3389/fpubh.2017.00015",
language = "English (US)",
volume = "5",
journal = "Frontiers in Public Health",
issn = "2296-2565",
publisher = "Frontiers Media S. A.",
number = "FEB",

}

TY - JOUR

T1 - Development and evaluation of a train-the-trainer workshop for hong kong community social service agency staff

AU - Zhou, Qianling

AU - Stewart, Sunita M.

AU - Wan, Alice

AU - Leung, Charles Sai Cheong

AU - Lai, Agnes Y.

AU - Lam, Tai Hing

AU - Chan, Sophia Siu Chee

PY - 2017/2/13

Y1 - 2017/2/13

N2 - Introduction: Capacity building approaches are useful in large-scale community-based health promotion interventions. However, models to guide and evaluate capacity building among social service agency staff in community settings are rare in the literature. This paper describes the development and evaluation of a 1-day (7 h) train-the-trainer (TTT) workshop for the "Enhancing Family Well-Being Project". The workshop aimed at equipping staff from different community agencies with the knowledge and skills to design, implement, and evaluate positive psychology-based interventions for their clients in Sham Shui Po, an over-crowded and low-income district in Hong Kong. Methods: The current TTT extended and improved on our previous successful model by adding research and evaluation methods (including the Logic Model, process evaluation, and randomized controlled trial), which are important to plan and evaluate the community interventions. Evaluation of the TTT was guided by the Integrated Model of Training Evaluation and Effectiveness (IMTEE), with quantitative and qualitative methods. Quantitative data were collected from pretraining (T1), post-training (T2), and 6-month (T3) and 12-month (T4) follow-up surveys. Qualitative data were collected from four focus groups of agency staff after the intervention. Results: Ninety-three staff from 30 community agencies attended the training, and 90 completed the baseline survey. Eighty-eight, 63, and 57 staff performed the evaluations at T2, T3, and T4, respectively. Agency staff were satisfied with the TTT. Immediate enhancement of knowledge, self-efficacy, and positive attitudes toward the training content was found at T2 (Cohen's d ranged from 0.24 to 1.22, all p < 0.05). Enhancement of knowledge of all training contents persisted at T3 and T4 (Cohen's d ranged from 0.34 to 0.63, all p < 0.05). Enhancement of self-efficacy in the use of positive psychology in intervention design persisted at T3 (Cohen's d = 0.22, p = 0.04). The skills learned were utilized to plan and develop subsequent interventions. Twenty-nine interventions were successfully designed and implemented by the agency staff, and delivered to 1,586 participants. The agency staff indicated their intention to utilize the skills they had learned for other interventions (score =4 out of 6) and to share these skills with their colleagues. Qualitative feedbacks from 23 agency staff supported the quantitative results. Conclusion: Our brief TTT was effectively delivered to a large number of agency staff and showed effects that persisted up to 12 months. Our training and evaluation models may offer a template for capacity building among social service agency staff for community brief, universal family health promotion interventions in diverse settings.

AB - Introduction: Capacity building approaches are useful in large-scale community-based health promotion interventions. However, models to guide and evaluate capacity building among social service agency staff in community settings are rare in the literature. This paper describes the development and evaluation of a 1-day (7 h) train-the-trainer (TTT) workshop for the "Enhancing Family Well-Being Project". The workshop aimed at equipping staff from different community agencies with the knowledge and skills to design, implement, and evaluate positive psychology-based interventions for their clients in Sham Shui Po, an over-crowded and low-income district in Hong Kong. Methods: The current TTT extended and improved on our previous successful model by adding research and evaluation methods (including the Logic Model, process evaluation, and randomized controlled trial), which are important to plan and evaluate the community interventions. Evaluation of the TTT was guided by the Integrated Model of Training Evaluation and Effectiveness (IMTEE), with quantitative and qualitative methods. Quantitative data were collected from pretraining (T1), post-training (T2), and 6-month (T3) and 12-month (T4) follow-up surveys. Qualitative data were collected from four focus groups of agency staff after the intervention. Results: Ninety-three staff from 30 community agencies attended the training, and 90 completed the baseline survey. Eighty-eight, 63, and 57 staff performed the evaluations at T2, T3, and T4, respectively. Agency staff were satisfied with the TTT. Immediate enhancement of knowledge, self-efficacy, and positive attitudes toward the training content was found at T2 (Cohen's d ranged from 0.24 to 1.22, all p < 0.05). Enhancement of knowledge of all training contents persisted at T3 and T4 (Cohen's d ranged from 0.34 to 0.63, all p < 0.05). Enhancement of self-efficacy in the use of positive psychology in intervention design persisted at T3 (Cohen's d = 0.22, p = 0.04). The skills learned were utilized to plan and develop subsequent interventions. Twenty-nine interventions were successfully designed and implemented by the agency staff, and delivered to 1,586 participants. The agency staff indicated their intention to utilize the skills they had learned for other interventions (score =4 out of 6) and to share these skills with their colleagues. Qualitative feedbacks from 23 agency staff supported the quantitative results. Conclusion: Our brief TTT was effectively delivered to a large number of agency staff and showed effects that persisted up to 12 months. Our training and evaluation models may offer a template for capacity building among social service agency staff for community brief, universal family health promotion interventions in diverse settings.

KW - Capacity building

KW - Community-based intervention

KW - Positive psychology

KW - Social service agency staff

KW - Social work

KW - Train-the-trainer

KW - Training evaluation

UR - http://www.scopus.com/inward/record.url?scp=85016136215&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016136215&partnerID=8YFLogxK

U2 - 10.3389/fpubh.2017.00015

DO - 10.3389/fpubh.2017.00015

M3 - Article

C2 - 28243586

AN - SCOPUS:85016136215

VL - 5

JO - Frontiers in Public Health

JF - Frontiers in Public Health

SN - 2296-2565

IS - FEB

M1 - 15

ER -