A Rapid Review of Evaluation Capacity-Building Strategies for Chronic Disease Prevention
DOI:
https://doi.org/10.3138/cjpe.61270Keywords:
chronic disease prevention, evaluation capacity, evaluation capacity buildingAbstract
There has yet, it seems, to be a review of the literature specifically exploring evaluation capacity building (ECB) for chronic disease prevention (CDP). To guide efforts to build evaluation capacity for CDP, a rapid review of the literature was undertaken using systematic methods. A search was conducted of the grey and academic literature to explore ECB strategies in CDP, and 14 articles were retained. CDP ECB strategies were similar to general public health ECB efforts (multi-strategy, context-specific, experiential). Articles included a focus on how to maintain ECB over long periods and in light of staff turnover, both of which were described as being prevalent in the CDP context. Evaluating influence at multiple levels (individual, organizational, system) is also important. There is room for more clarity about the “how” of ECB strategies, and about specificity to CDP.
References
Allen, P., O’Connor, J. C., Best, L. A., Lakshman, M., Jacob, R. R., & Brownson, R. C. (2018). Management practices to build evidence-based decision-making capacity for chronic disease prevention in Georgia: A case study. Preventing Chronic Disease, 15, E92. https://doi.org/10.5888/pcd15.170482. Medline:30004862
Bergeron, K., Abdi, S., DeCorby, K., Mensah, G., Rempel, B., & Manson, H. (2017). Theories, models and frameworks used in capacity building interventions relevant to public health: A systematic review. BMC Public Health, 17(1), 914. https://doi.org/10.1186/s12889-017-4919-y. Medline:29183296
Bourgeois, I., & Cousins, J. B. (2013). Understanding dimensions of organizational evaluation capacity. American Journal of Evaluation, 34(3), 299 – 319. https://doi.org/10.1177/1098214013477235
Bourgeois, I., Simmons, L., & Buetti, D. (2018). Building evaluation capacity in Ontario’s public health units: Promising practices and strategies. Public Health, 159, 89 – 94. https://doi.org/10.1016/j.puhe.2018.01.031. Medline:29599056
Bourgeois, I., Whynot, J., & Thériault, E. (2015). Application of an organizational evaluation capacity self-assessment instrument to different organizations: Similarities and lessons learned. Evaluation and Program Planning, 50, 47 – 55. https://doi.org/10.1016/j.evalprogplan.2015.01.004. Medline:25757074
Compton, D. W., Baizerman, M., Preskill, H., Rieker, P., & Miner, K. (2001). Developing evaluation capacity while improving evaluation training in public health: The American Cancer Society’s Collaborative Evaluation Fellows Project. Evaluation and Program Planning, 24(1), 33 – 40. https://doi.org/10.1016/s0149-7189(00)00045-8
Compton, D. W., MacDonald, G., Baizerman, M., Schooley, M., & Zhang, L. (2008). Using Evaluation Capacity Building (ECB) to interpret evaluation strategy and practice in the United States National Tobacco Control Program (NTCP): A preliminary study. Canadian Journal of Program Evaluation, 23(3), 199 – 224.
DeCorby-Watson, K., Mensah, G., Bergeron, K., Abdi, S., Rempel, B., & Manson, H. (2018). Effectiveness of capacity building interventions relevant to public health practice: A systematic review. BMC Public Health, 18(1), 684. https://doi.org/10.1186/s12889018-5591-6. Medline:29859075
Dobbins, M. (2017). Rapid review guidebook: Steps for conducting a rapid review. National Collaborating Centre for Methods and Tools. Retrieved from http://www.nccmt.ca/uploads/media/media/0001/01/a816af720e4d587e13da6bb307df8c907a5dff9a.pdf
Dryden, E., Hyde, J., Livny, A., & Tula, M. (2010). Phoenix rising: Use of a participatory approach to evaluate a federally funded HIV, hepatitis and substance abuse prevention program . Evaluation and Program Planning, 33(4), 386 – 393. https://doi.org/10.1016/j.evalprogplan.2010.02.004. Medline:20233628
Fourney, A., Gregson, J., Sugerman, S., & Bellow, A. (2011). Building evaluation capacity in local programs for multisite nutrition education interventions. Journal of Nutrition Education and Behavior, 43(4 Suppl 2), S130 – 136. https://doi.org/10.1016/j.jneb.2011.02.005. Medline:21683282
Gilliam, A., Barrington, T., Davis, D., Lacson, R., Uhl, G., & Phoenix, U. (2003). Building evaluation capacity for HIV prevention programs. Evaluation and Program Planning, 26(2), 133 – 142. https://doi.org/10.1016/s0149-7189(03)00012-0
Godin, K., Stapleton, J., Kirkpatrick, S. I., Hanning, R. M., & Leatherdale, S. T. (2015). Applying systematic review search methods to the grey literature: A case study examining guidelines for school-based breakfast programs in Canada. Systematic Reviews, 4(1), 138. https://doi.org/10.1186/s13643-015-0125-0. Medline:26494010
Hanusaik, N., O’Loughlin, J. L., Kishchuk, N., Paradis, G., & Cameron, R. (2010). Organizational capacity for chronic disease prevention: A survey of Canadian public health organizations. European Journal of Public Health, 20(2), 195 – 201. https://doi.org/10.1093/eurpub/ckp140. Medline:19843599
Hotte, N., Simmons, L., Beaton, K., & the LDCP Workgroup. (2015). Scoping review of evaluation capacity building strategies. Cornwall, ON: Public Health Ontario.
Johnston, S., Liddy, C., Mill, K., & Irving, H. (2012). Building the evidence base for chronic disease self-management support interventions across Canada. Canadian Journal of Public Health, 103(6), 462 – 467.
Kemner, A. L., Stachecki, J. R., Bildner, M. E., & Brennan, L. K. (2015). Increasing community capacity for participatory evaluation of healthy eating and active living strategies through direct observations and environmental audits. Journal of Public Health Management and Practice, 21(Suppl 3), S90 – S95. https://doi.org/10.1097/phh.0000000000000212. Medline:25828230
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012). Evidence summaries: The evolution of a rapid review approach. Systematic Reviews, 1(1), 10. https://doi.org/10.1186/2046-4053-1-10. Medline:22587960
Kirsh, B., Krupa, T., Horgan, S., Kelly, D., & Carr, S. (2005). Making it better: Building evaluation capacity in community mental health. Psychiatric Rehabilitation Journal, 28(3), 234 – 241. https://doi.org/10.2975/28.2005.234.241. Medline:15690736
Labin, S. N., Duffy, J. L., Meyers, D. C., Wandersman, A., & Lesesne, C. A. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33(3), 307 – 338.
Lindeman, P. T., Bettin, E., Beach, L. B., Adames, C. N., Johnson, A. K., Kern, D., ... Phillips, G. (2018). Evaluation capacity building: Results and reflections across two years of a multisite empowerment evaluation in an HIV prevention context. Evaluation and Program Planning, 71, 83 – 88. https://doi.org/10.1016/j.evalprogplan.2018.09.001. Medline:30223173
Martin, I., & Carey, J. C. (2012). Evaluation capacity within state-level school counseling programs: A cross-case analysis. Professional School Counseling, 15(3), 110 – 122.
Milstein, B., Wetterhall, S. & CDC Working Group. (2000). A framework featuring steps and standards for program evaluation. Health Promotion Practice, 1(3), 221 – 228.
Ministry of Health and Long-Term Care [Ontario]. (2018). Chronic disease prevention guideline, 2018. Retrieved from http://health.gov.on.ca/en/pro/programs/publichealth/oph_ standards/docs/protocols_guidelines/Chronic_Disease_Prevention_Guideline_2018.pdf
Naccarella, L., Pirkis, J., Kohn, F., Morley, B., Burgess, P., & Blashki, G. (2007). Building evaluation capacity: Definitional and practical implications from an Australian case study. Evaluation and Program Planning, 30(3), 231 – 236. https://doi.org/10.1016/j.evalprogplan.2007.05.001. Medline:17689328
Nichols, N., McFarlane, K., Gibson, P., Millard, F., Packer, A., & McDonald, M. (2018). Skills, systems and supports: An Aboriginal Community Controlled Health Service (Apunipima) approach to building health promotion evaluation capacity of staff. Health Promotion Journal of Australia, 29(1), 18 – 22. https://doi.org/10.1002/hpja.18. Medline:29700933
Norton, S., Milat, A., Edwards, B., & Giffin, M. (2016). Narrative review of strategies by organizations for building evaluation capacity. Evaluation and Program Planning, 58, 1 – 19. https://doi.org/10.1016/j.evalprogplan.2016.04.004. Medline:27258905
Nu’Man, J., King, W., Bhalakia, A., & Criss, S. (2007). A framework for building organizational capacity integrating planning, monitoring, and evaluation. Journal of Public Health Management and Practice, 13, S24 – S32. https://doi.org/10.1097/00124784200701001-00006. Medline:17159464
Office of the Auditor General of Ontario. (2017a). Summary: Public health: Chronic disease prevention. Value-for-money audit. Retrieved from http://www.auditor.on.ca/en/content/news/17_summaries/2017AR%20summary%203.10.pdf
Office of the Auditor General of Ontario. (2017b). Chapter 3: Reports on value-for-money audits. 3.10 Public health: Chronic disease prevention. Toronto, ON. Retrieved from http://www.auditor.on.ca/en/content/annualreports/arreports/en17/2017AR_v1_en_web.pdf
Ohmer, M. L. (2008). Assessing and developing the evidence base of macro practice interventions with a community and neighborhood focus. Journal of Evidence-Based Social Work, 5(3–4), 519 – 547. https://doi.org/10.1080/15433710802084284. Medline:19042879
Satterlund, T. D., Treiber, J., Kipke, R., Kwon, N., & Cassady, D. (2013). Accommodating diverse clients’ needs in evaluation capacity building: A case study of the Tobacco Control Evaluation Center. Evaluation and Program Planning, 36(1), 49 – 55. https://doi.org/10.1016/j.evalprogplan.2012.05.004. Medline:22784967
Stockdill, S. H., Baizerman, M., & Compton, D. W. (2002). Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation, 2002(93), 7 – 26. https://doi.org/10.1002/ev.39
Treiber, J., Cassady, D., Kipke, R., Kwon, N., & Satterlund, T. (2011). Building the evaluation capacity of California’s local tobacco control programs. Health Promotion Practice, 12(6 Suppl 2), 118S – 124S. https://doi.org/10.1177/1524839911414411. Medline:22068574
World Health Organization (WHO). (2005). Preventing chronic diseases: A vital investment. Geneva, Switzerland: Author. Retrieved from https://www.who.int/chp/chronic_disease_report/contents/en/
World Health Organization (WHO). (2017). Ten years in public health 2007–2017. Geneva, Switzerland: Author. Retrieved from https://www.who.int/publications/10year-review/en/
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Andrea LaMarre, Eric d’Avernas, Barbara Riley, Amanda Raffoul, Ruchika Jain
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
