Strengthening Evaluation Capacity Building Practice Through Competition
The Max Bell School of Public Policy’s Evaluation Capacity Case Challenge
DOI:
https://doi.org/10.3138/cjpe-2024-0012Keywords:
evaluation capacity building, evaluation training, evaluation case competition, emerging evaluators, organizational learningAbstract
Despite the attention evaluation capacity building (ECB) has received over the past several decades, surprisingly few opportunities for learning about ECB exist. In response to this need, the Max Bell School of Public Policy at McGill University, in collaboration with ECB scholars across Canada, created a case competition focused exclusively on ECB—the Evaluation Capacity Case Challenge (EC3). Twenty individuals interested in learning about ECB and one organization (case site) interested in enhancing their existing evaluation capacity were selected to participate through a competitive application process. Participants attended a series of online workshops and engaged with an ECB coach to hone their skills and then took part in a two-day hybrid case challenge event where they had 24 hours to craft an ECB plan in response to a specific case challenge question presented by case site representatives. In this article, the authors describe EC3 in detail and share some key reflections from the inaugural year.
References
Alkin, M. C., & Christie, C. A. (Eds.). (2022). Evaluation roots: Theory influencing practice (3rd ed.). Guilford Press.
American Evaluation Association. (2018). Guiding principles. https://www.eval.org/Portals/0/Docs/AEA_289398-18_GuidingPrinciples_Brochure_2.pdf
Bourgeois, I., Lemire, S. T., Fierro, L. A., Castleman, A. M., & Cho, M. (2023). Laying a solid foundation for the next generation of evaluation capacity building: Findings from a comprehensive review. American Journal of Evaluation, 44(1), 29–49.
Buchanan, H. (2015). A made-in-Canada credential: Developing an evaluation professional designation. Canadian Journal of Program Evaluation, 29(3), 33–53.
Canadian Evaluation Society. (2018). Competencies for Canadian evaluation practice. https://evaluationcanada.ca/files/pdf/2_competencies_cdn_evaluation_practice_2018.pdf
Castleman, A. M. (2021). Toward an understanding of ECB practitioner competencies [Unpublished master’s thesis]. Claremont Graduate University.
Cho, M. (2021). Applying the AEA evaluator competencies to improve evaluation training programs [Unpublished master’s thesis]. Claremont Graduate University.
Hunter, M. T., & McDavid, J. C. (2019). Comparison of Canadian and American graduate evaluation education programs. Canadian Journal of Program Evaluation, 34(2), 207–234.
King, J. A., & Stevahn, L. (2020). Presenting the 2018 AEA Evaluator Competencies. New Directions for Evaluation, 2020(168): 49–61.
LaVelle, J. M. (2020). Educating evaluators 1976–2017: An expanded analysis of university-based evaluation education programs. American Journal of Evaluation, 41(4), 494–509.
Lemire, S., Nielsen, S. B., & Christie, C. A. (2018). Toward understanding the evaluation market and its industry – Advancing a research agenda. New Directions for Evaluation, 2018(160), 145–163.
Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice: A comprehensive guide. Guilford Press.
Preskill, H. & Torres, R.T. (2000). The Readiness for Organizational Learning and Evaluation Instrument. Acquired from https://www.fsg.org/wp-content/uploads/2021/08/Readiness-for-Organizational-Learning-and-Evaluation-Survey-Instrument.pdf
Scriven, M. (2008). The concept of a transdiscipline: And of evaluation as a transdiscipline. Journal of MultiDisciplinary Evaluation, 5(10), 65–66.
Searle, M., Fierro, L., Pinarski, J., Dixon, L., Tremblay, M., Bourgeois, I., & Gokiert, R. (2024). Meeting the challenge: How the City of Kingston is working to propel evaluation growth. Canadian Journal of Program Evaluation, 38(3), 555–565,
Searle, M., Hughes, J., Carone, K., Fierro, L., Tremblay, M., Gokiert, R., & Bourgeois, I., (2024). Learning from evaluation data: Discoveries from the inaugural Evaluation Capacity Case Challenge. Canadian Journal of Program Evaluation, 38(3), 542–554.
Sutter, A., Rondeau, M., Kaminska, K., Desforges, S., Bettzer, S., & Tremblay, M. (2024). Developing evaluation capacity building competencies: Participant reflections from the Evaluation Capacity Case Challenge. Canadian Journal of Program Evaluation, 38(3), 532–541.
Yarbrough, D. B., Shula, L. M., Hopson, R. K., & Caruthers, F. A. (2010). The Program Evaluation Standards: A guide for evaluators and evaluation users (3rd ed). Corwin Press.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Leslie A. Fierro, Isabelle Bourgeois, Rebecca Gokiert, Michelle Searle, Melissa Tremblay
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
