Building Evaluation Culture—The Missing Link

Authors

  • Kaireen Chaytor School of Public Administration, Dalhousie University, Halifax, Nova Scotia

DOI:

https://doi.org/10.3138/cjpe.75431

Keywords:

evaluative culture, contribution analysis, John Mayne, evaluation capacity building, organizational learning

Abstract

John Mayne maintained that an evaluative culture is essential for results-based management to be integrated and be of significance. He described conditions and actions necessary for such a culture. This article presents Mayne’s ideas and the experience of evaluators employing Mayne’s suggestions in their attempt to build an evaluative culture. The conclusion drawn is that more of our evaluation approaches and practices should connect to, or contribute to, an evaluative culture within organizations.

References

Barrados, M., & Mayne, J. (2003). Can public sector organizations learn? OECD Journal on Budgeting, 3(3), 87–103.

Bombart, D. (2015). Understanding evaluative culture. Institute for Development Strategy. Munich, Germany.

Bourgeois, I., & Cousins J. (2013). Understanding dimensions of organizational evaluation capacity. American Journal of Evaluation, 34(3), 299–319.

Bourgeois, I., & Whynot, J. (2023). Bridging evaluation theory and practice: The contributions of John Mayne to Canadian federal evaluation. Canadian Journal of Program Evaluation, 37(3), 324–339.

Boyle, R. (2003). Building effective evaluation capacity: Some lessons from international practice. Presentation to IDEA seminar: Rome.

Boyle, R., & Lemaire, D. (1999). Building effective evaluation capacity. Lessons from practice. New Brunswick, NJ: Transaction.

Cousins, J., Amo, C., Bourgeois, I., Chouinard, J., Goh, S., & Lahey, R. (2011). Organizational capacity to do and use evaluation: Results of a pan-Canadian survey of evaluators. Canadian Journal of Program Evaluation, 23(3), 1–35.

Cousins, J., Swee G., Elliott, J., & Bourgeois, I. (2014). Framing the capacity to do and use evaluation. New Directions for Evaluation, 141, 7–23.

Cousins, J. B., Goh, S. C., Clark, S., Lee, L. (2004). Integrating evaluative inquiry into the organizational culture: A review and synthesis of the knowledge base. Canadian Journal of Program Evaluation, 19(2), 99–141.

Kim, P. S. (2002). Cultural change in government: Promoting a high-performance culture. A review of ten years of modernization; The HRM perspective. Human Resources Management (HRM) Working Party Meeting. Paris: OECD https://www.oecd.org/officialdocuments/publicdisplaydocumentpdf/?cote=PUMA/HRM(2002)11&docLanguage=En

Lahey, R. (2023). John Mayne and the origins of evaluation in the public sector in Canada: A shaping of both evaluation and the evaluator. Canadian Journal of Program Evaluation, 37(3), 340–354.

Leviton, L. (2014). Some underexamined aspects of evaluation capacity building. American Journal of Evaluation, 35(1), 90–94.

Lipshitz, R., & Popper, M. (2000). Organizational learning in a hospital. Journal of Applied Behavioural Science, 38(1), 78–98.

Mayne, J. (2007). Challenges and lessons in implementing results-based management. Evaluation, 13(1), 87–109.

Mayne, J. (2008). Building an evaluative culture for effective evaluation and results management. ILAC Brief, 20. The Institutional Learning and Change Initiative. http://www.cgiar-ilac.org/files/publications/briefs/ILAC_Brief20_Evaluative_Culture.pdf

Mayne, J. (2010). Building an evaluative culture: The key to effective evaluation and result management. Canadian Journal of Program Evaluation, 24(2), 1–30.

Mayne, J. (2017). Theory of change analysis: Building robust theories of change models. Canadian Journal of Program Evaluation, 32(2), 155–173.

Mayne, J. (2020). Building evaluative culture in community services: caring for evidence. Evaluation and Program Planning, 80, 101450.

Mayne, J., & Mayne, R. S. (1983). Will program evaluation be used in formulating policy. In M. M. Atkinson & M. A. Chandler (Eds.), The politics of Canadian public policy (pp. 267–283). Toronto, Canada: University of Toronto Press.

Nielsen, S. B., Lemire, S., & Montague, S. (2023a). Remembering John Mayne—A practical thinker and a thinking practitioner. Canadian Journal of Program Evaluation, 37(3), 297–305.

Nielsen, S. B., Lemire, S., & Montague, S. (2023b). Using evaluative information sensibly. The enduring contributions of John Mayne. Canadian Journal of Program Evaluation, 37 (3), 473–493.

Nielsen, S. B., & Montague, S. (2023). John Mayne’s contribution to result-based management thinking: A leadership legacy. Canadian Journal of Program Evaluation, 37(3), 439–460.

Nutley, S. M., Walter, I., & Davies, H. T. O. (2007). Using evidence: How research can inform public services. Bristol, UK: Policy Press.

Preskill, H., & Boyle, S. (2008). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443–459.

Preskill, H., & Torres, R. (1999). Evaluative inquiry of learning in organizations. Thousand Oaks, CA: Sage.

Redmond, A. (2020). An appreciative inquiry case study of evaluation practice in a non-profit organization: Discovering the factors of a sustained practice (Unpublished master’s dissertation). St. Francis Xavier University.

Schein, E. (1990). Organizational culture. American Psychologist 45, 109–119.

Stewart, J. (2014). Developing a culture of evaluation and research, CFCA Paper No. 28. https://aifs.gov.au/resources/practice-guides/developing-culture-evaluation-and-research

Suarez-Balcazar, Y., & Taylor-Ritzler, T. (2014). Moving from science to practice in evaluation capacity building. American Journal of Evaluation, 35(1), 95–99.

Wandersman, A. (2014). Moving forward with the science and practice of evaluation capacity building (ECB): The why, how, what and outcomes of ECB. American Journal of Evaluation, 35(1), 87–89.

Downloads

Published

2023-03-17

How to Cite

Chaytor, K. (2023). Building Evaluation Culture—The Missing Link. Canadian Journal of Program Evaluation, 37(3), 422–438. https://doi.org/10.3138/cjpe.75431

Issue

Section

Articles

Most read articles by the same author(s)