Meeting the Challenge
How the City of Kingston Is Working to Propel Evaluation Growth
DOI:
https://doi.org/10.3138/cjpe-2024-0006Keywords:
collaboration, community-engaged learning, evaluation capacity building, evaluation competition, municipal governmentAbstract
This practice note shares key learnings from the inaugural Evaluation Capacity Case Challenge (EC3) held by the Max Bell School of Public Policy in April 2023. The purpose is to give readers an opportunity to consider how to shape evaluation capacity in general and within a municipal context. Evaluation capacity building (ECB) is a multifaceted concept to support shared learning about and understanding of evaluation. Strands of learning about ECB emerged from EC3 that can be applied within organizations. These centre on three important actions: (1) establishing a community of practice led by champions, (2) scaling and sequencing evaluation capacity, and (3) developing data literacy as a technical skill. The ECB strategies developed in EC3 offered new ways for the City of Kingston to consider and reconsider how it conducts, shares, learns from, and uses evaluation. Here, the authors describe evaluation within the City of Kingston, the city’s goals in entering EC3, key learnings from the challenge, and the city’s ensuing efforts to propel the growth of evaluation.
References
Alcalde-Rabanal, J. E., Becerril-Montekio, V. M., & Langlois, E. V. (2018). Evaluation of communities of practice performance developing implementation research to enhance maternal health decision-making in Mexico and Nicaragua. Implementation Science, 13, 41.
Bonikowska, A., Sanmartin, C., & Frenette, M. (2019). Data literary: What it is and how to measure it in the public service. Statistic Canada.
Bourgeois, I., Lemire, S. T., Fierro, L. A., Castleman, A. M., & Cho, M. (2023). Laying a solid foundation for the next generation of evaluation capacity building: Findings from an integrative review. American Journal of Evaluation, 44(1), 29–49.
Buckley, J., Archibald, T., Hargraves, M., & Trochim, W. M. (2015). Defining and teaching evaluative thinking: Insights from research on critical thinking. American Journal of Evaluation, 36(3), 375–388.
Canadian Evaluation Society. (2018). Competencies for Canadian evaluation practice. https://evaluationcanada.ca/files/pdf/2_competencies_cdn_evaluation_practice_2018.pdf
City of Kingston. (2017, October 3). Public engagement framework. https://www.cityofkingston.ca/documents/10180/17772359/Projects_PublicEngagment Framework_Final.pdf/6ac0149e-e928-4074-9827-1d7db30c0013?t=1610977952727
City of Kingston. (n.d.). Get involved Kingston. Retrieved November 21, 2023, from https://getinvolved.cityofkingston.ca/
Fierro, L. A., & Christie, C. A. (2017). Evaluator and program manager perceptions of evaluation capacity and evaluation practice. American Journal of Evaluation, 38(3), 376–392.
Fierro, L. A., Kinarsky, A. R., Echeverria-Estrada, C., Sabat Bass, N., & Christie, C. A. (2022). The importance of implementation: Putting evaluation policy to work. New Directions for Evaluation, 2022(173), 49–62.
King, J. A. (2020). Putting evaluation capacity building in context: Reflections on the Ontario Brain Institute’s Evaluation Support Program. Evaluation and Program Planning, 80, 101452–101456.
Kreutzmann, A. (2022). Communities of practice as vibrant sources of knowledge and innovation within a rigid public hierarchy. Forschungs-/Entwicklungs-/Innovations-Management, 1, 1–113.
Langlois, M., Blanchet-Cohen, N., & Beer, T. (2012). The art of the nudge: Five practices for developmental evaluators. Canadian Journal of Program Evaluation, 27(2), 39–59.
Mark, M. M., & Hart, N. (2022). Editors’ notes. New Directions for Evaluation, 2022(173), 7–8.
Mayne, J. (2009). Building an evaluative culture: The key to effective evaluation and results management. Canadian Journal of Program Evaluation, 24(2), 1–30.
Preskill, H., & Torres, R. T. (1999). Building capacity for organizational learning through evaluative inquiry. Evaluation, 5(1), 42–60.
Rogers, A. F., & Gullickson, A. (2018). Evaluation champions: A literature review. Journal of Multidisciplinary Evaluation, 14(30), 46–63.
Silliman, B., Crinion, P., & Archibald, T. (2016). Evaluation champions: What they need and where they fit in organizational learning. Journal of Human Sciences and Extension, 4(3), 22–44.
Sperry, J. (2018). Data literacy: Exploring economic data (2018 Economic Programs Webinar Series). U.S. Census Bureau.
Stockdill, S., Baizerman, M., & Compton, D. W. (2002). Toward a definition of the ECB process: A conversation with the ECB literature. New Directions for Evaluation, 2002(93), 7–26.
Thaler, R. H., & Sunstein, C. R. (2021). Nudge: The final edition (Updated ed.). Penguin Books.
Thomas, V. G., & Campbell, P. B. (2021). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. SAGE.
Wanzer, D. L. (2021). What is evaluation? Perspectives of how evaluation differs (or not) from research. American Journal of Evaluation, 42(1), 28–46.
Wenger, E., McDermott, R., Snyder, W. M., & Lakomski, G. (2002). Cultivating communities of practice: A guide to managing knowledge [Review of Cultivating communities of practice: a guide to managing knowledge]. British Journal of Management, 15(Special), 89–95.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Michelle Searle, Leslie A. Fierro, Jen Pinarski, Laurie Dixon, Melissa Tremblay, Isabelle Bourgeois, Rebecca Gokiert
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
