The Use and Benefits of Evaluation Framework Modules at the Canadian Foundation for Healthcare Improvement

Engaged Capacity Building and Collaborative Program Evaluation Planning

Authors

  • Julia Halar Canadian Foundation for Healthcare Improvement
  • Selma Didic Canadian Foundation for Healthcare Improvement
  • Eden Amare City of Toronto
  • Lise Labrecque City of Ottawa
  • Margo Rowan Principle Rowan Research and Evaluation

DOI:

https://doi.org/10.3138/cjpe.69230

Keywords:

capacity building, co-creation, collaboration, evaluation planning, program evaluation

Abstract

The Canadian Foundation for Healthcare Improvement (CFHI) shares its experience using a collaborative approach to developing evaluation frameworks. CFHI introduced a series of four participatory workshop modules where technical and content experts co-design evaluation frameworks. This method leverages the expertise within the evaluation team to build organization-wide evaluation capacity. This practice note describes the modules, their delivery, and lessons learned. Participants’ feedback suggests that evaluation modules are an effective strategy to strengthen the relationship and communication between evaluation experts and program staff.

References

Canadian Evaluation Society (CES). (2018, November 2). Competencies for Canadian evaluators. Retrieved from https://evaluationcanada.ca/competencies-canadianevaluators

Cousins, J. B., & Earl, L. M. (1995). The case for participatory evaluation: Theory, research, practice. In J. B. Cousins and L. M. Earl (Eds.), Participatory evaluation in education: Studies in evaluation use and organizational learning (pp. 3–18). London, England: Falmer Press.

Cousins, J. B., Whitmore, E., Shulha, L., Al Hudib, H., & Gilbert, N. (2015). Principles to guide collaborative approaches to evaluation. Retrieved from https://evaluationcanada.ca/sites/default/files/20170131_caebrochure_en.pdf

Edey, S., & Newton, P. (1995). Collaborative inquiry: Integrating evaluation into the workplace. In A. J. Love (Ed.), Evaluation methods sourcebook II (pp. 4 - 16). Ottawa, ON: CES. Retrieved from https://evaluationcanada.ca/secure/sb2_ch1.pdf

Government of Canada (GOC). (2012, October 25). Theory-based approaches to evaluation: Concepts and practices. Retrieved from https://www.canada.ca/en/treasury-boardsecretariat/services/audit-evaluation/centre-excellence-evaluation/theory-basedapproaches-evaluation-concepts-practices.html

Government of Canada (GOC). (2016, July 1). Policy on results. Retrieved from https:// www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=31300&section=html

Institute for Healthcare Improvement (IHI). (2018, October 31). How to improve . Retrieved from http://www.ihi.org/resources/Pages/HowtoImprove/default.aspx

Lemire, S., Whynot, J., & Montague, S. (2019). How we model matters: A manifesto for the next generation of program theorizing. Canadian Journal of Program Evaluation, 33 (3), 414–433. https://doi.org/10.3138/cjpe.53070

Love, A. J. (1991). Internal evaluation: Building organizations from within. Newbury Park, CA: Sage. Mertens, D. M., & Wilson, A. T. (2019). Program evaluation theory and practice (2nd ed.). New York, NY: The Guildford Press.

Moreau, K. A., Peddle, B., & Eady, K. (2015). The promise of participatory evaluation in family-centered rehabilitation settings: A qualitative study . Journal of MultiDisciplinary Evaluation, 11(25), 1–13. Retrieved from http://journals.sfu.ca/jmde/index.php/ jmde_1/article/view/406

Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage.

Patton, M. Q. (2014). Evaluation flash cards: Embedding evaluative thinking in organizational culture. St. Paul, MN: Otto Bremner Trust.

Stockdill, S. H., Baizerman, M., & Compton, D. W. (2002). Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation, 2002 (93), 7–26. https://doi.org/10.1002/ev.39

Treasury Board of Canada (TB). (2016, July). Directive on results. Retrieved from https://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=31306&section=html

Vo, A. T., & Archibald, T. (2018). New directions for evaluative thinking. Evaluative Thinking. New Directions for Evaluation, 2018 (158), 139–147. https://doi.org/10.1002/ev.20317

Whitmore, E. , Al Hudib, H. , Cousins, J. B. , Shulha, L. M. , & Gilbert, N. (2017). Reflections on the meaning of success in collaborative approaches to evaluation: Results of an empirical study. Canadian Journal of Program Evaluation, 31(3), 328 – 349. https://doi.org/10.3138/cjpe.335

Downloads

Published

2020-04-21

How to Cite

Halar, J., Didic, S., Amare, E., Labrecque, L., & Rowan, M. (2020). The Use and Benefits of Evaluation Framework Modules at the Canadian Foundation for Healthcare Improvement: Engaged Capacity Building and Collaborative Program Evaluation Planning. Canadian Journal of Program Evaluation, 35(2), 258–267. https://doi.org/10.3138/cjpe.69230

Issue

Vol. 35 No. 2 (2020): Fall

Section

Research and Practice Notes

License

Copyright (c) 2020 Julia Halar, Selma Didic, Eden Amare, Lise Labrecque, Margo Rowan

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.

Authors retain copyright of their work and grant the journal right of first publication.

Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

Most read articles by the same author(s)