L’évaluation évolutive, de la théorie à la pratique : perspectives de praticiens québécois
DOI:
https://doi.org/10.3138/cjpe.70502Keywords:
community of practice, developmental evaluation, scoping review, social innovation, PattonAbstract
Quebec and Canadian organizations, communities, and professionals working collectively to address complex social issues in dynamic contexts are enthusiastically embracing social innovation. Some limitations in evaluating this innovation have been revealed by formative and summative evaluation approaches. Developmental evaluation (DE) could be a potential solution. This article combines scientific literature with the experience of experienced DE practitioners in Quebec. Balancing project management and evaluation, knowledge production and transformation of practices, continuous iterations and setting deadlines is at the very core of an effective DE approach.
References
Anderson, A. A. (2005). The community builder’s approach to theory of change: A practical guide to theory development. New York: The Aspen Institute Roundtable on Community Change.
Arksey, H. et O’Malley, L. (2005). Scoping studies: Towards a methodological framework . International Journal of Social Research Methodology, 8(1), 19 – 32. https://doi.org/10.1080/1364557032000119616. Medline:31705429
Baldwin, C. K. et Lander, R. (2019). Developmental evaluator functional role activities and programmatic developments: A case study analysis. American Journal of Evaluation, 40(1), 35 – 54. https://doi.org/10.1177/1098214017743586
Bouchard, C. (2006). Groupe de travail sur l’innovation sociale, 1999. Contribution à une politique de l’immatériel. Recherche en sciences humaines et sociales et innovations sociales. Québec, Canada: Conseil québécois de la recherche sociale.
Brousselle, A., Champagne, F., Contandriopoulos, A.-P. et Hartz, Z. (2011). L’évaluation : concepts et méthodes. Montréal, QC: Presses de l’Université de Montréal.
Buetti, D., Bourgeois, I. et Savard, S. (2019). Modélisation des capacités organisationnelles en évaluation dans le secteur communautaire et implications pour le contexte québécois. Revue canadienne de recherche sur les OSBL et l’économie sociale, 10(2). https://doi.org/10.29173/cjnser.2019v10n2a287
Cabaj, M. (2011). Developmental evaluation: The experience and reflections of early adopters (Master of Arts). University of Waterloo, Waterloo, Ontario, Canada.
Cabaj, M. (2014). Evaluating collective impact: Five simple rules. The Philanthropist, 26(1).
Cartland, J., Ruch-Ross, H. S., Mason, M. et Donohue, W. (2008). Role sharing between evaluators and stakeholders in practice. American Journal of Evaluation, 29(4), 460 –477. https://doi.org/10.1177/1098214008326201
Contandriopoulos, A. P., Champagne, F., Denis, J. L. et Avargues, M. C. (2000). Evaluation in the health sector: Concepts and methods . Revue d’épidémiologie et de santé publique, 48(6), 517 – 539.
Contandriopoulos, D. et Brousselle, A. (2012). Evaluation models and evaluation use . Evaluation (London, England: 1995), 18(1), 61 – 77. https://doi.org/10.1177/1356389011430371. Medline:23526460
Contandriopoulos, D., Lemire, M., Denis, J.-L. et Tremblay, E. (2010). Knowledge exchange processes in organizations and policy arenas: A narrative systematic review of the literature. The Milbank Quarterly, 88(4), 444 – 483. https://doi.org/10.1111/j.14680009.2010.00608.x. Medline:21166865
Costa, A. et Kallick, B. (1993). Through the lens of a critical friend. Educational Leadership, 51(2), 49 – 51.
Cousins, J. B. (2005). Will the real empowerment evaluation please stand up? A critical friend perspective. Dans D. M. Fetterman et A. Wandersman (éds.), Empowerment evaluation principles in practice (pp. 183 – 208). New York, NY: The Guilford Press.
Dawson, P. et Daniel, L. (2010). Understanding social innovation: A provisional framework. International Journal of Technology Management, 51(1), 9 – 21. https://doi.org/10.1504/ijtm.2010.033125
Dickson, R. et Saunders, M. (2014). Developmental evaluation: Lessons for evaluative practice from the SEARCH program. Evaluation, 20(2), 176 – 194. https://doi.org/10.1177/1356389014527530
Dozois, E., Langlois, M. et Blanchet-Cohen, N. (2010). DE 201 : Guide du praticien de l’évaluation évolutive. Montreal, Canada: J. W. McConnell Family Foundation, International Institute for Child Rights and Development, University of Victoria.
Fetterman, D. M. (2001). Foundations of empowerment evaluation. Thousand Oaks, CA: Sage.
Fortin, A., et coll. (2018). Guide pratique sur l’impact. Consulté au https://creativite33.files.wordpress.com/2018/05/guide_pratique_impact_2018.pdf
Gamble, J. A. A. (2008). ABC de l’évaluation évolutive. Montréal, QC: La fondation de la famille J.W. McConnell.
Greenhalgh, T. , Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O. et Peacock, R. (2005). Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Social Science & Medicine, 61(2), 417 – 30.
Guba, E. G. et Lincoln, Y. S. (1998). Competing paradigms in qualitative research. Dans N. K. Denzin et Y. S. Lincoln (éds.), The landscape of qualitative research: Theories and issues (pp. 195 – 220). Thousand Oaks, CA: Sage.
Harji, K. et Jackson, E. T. (2016). Developmental evaluation in practice: Lessons from evaluating a market-based employment initiative. New York, NY: The Rockefeller Foundation.
Hayes, H. G., Witkowski, S. et Smith, L. (2016). Failing forward quickly as a developmental evaluator: Lessons from year one of the LiveWell Kershaw Journey. Journal of Multi-Disciplinary Evaluation, 12(27), 112 – 118.
House, E. R. et Howe, K. R. (1999). Values in evaluation and social research. Thousand Oaks, CA: Sage.
Lam, C. Y. (2015). Exploring the leadership dimension of developmental evaluation: The evaluator as a servant-leader. Canadian Journal of Program Evaluation, 30(1), 64 – 78. https://doi.org/10.3138/cjpe.30.1.64
Langeveld, K., Stronks, K. et Harting, J. (2016). Use of a knowledge broker to establish healthy public policies in a city district: A developmental evaluation. BMC Public Health, 16(1), 271. https://doi.org/10.1186/s12889-016-2832-4. Medline:26979063
Langlois, M., Blanchet-Cohen, N. et Beer, T. (2013). The art of the nudge: Five practices for developmental evaluators. Canadian Journal of Program Evaluation, 27, 39 – 59.
Leonard, S. N., Fitzgerald, R. N. et Riordan, G. (2016). Using developmental evaluation as a design thinking tool for curriculum innovation in professional higher education. Higher Education Research et Development, 35(2), 309 – 321. https://doi.org/10.1080/07294360.2015.1087386
Levac, D., Colquhoun, H. et O’Brien, K. K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5(1), 69. https://doi.org/10.1186/1748-5908-5-69. Medline:20854677
Meunier, A. (2013). L’évaluation évolutive en bref. Montréal, QC: Communagir.
Miller, R. L. et Campbell, R. (2006). Taking stock of empowerment evaluation: An empirical review. American Journal of Evaluation, 27(3), 296 – 319. https://doi.org/10.1177/109821400602700303
Milley, P., Szijarto, B., Svensson, K. et Cousins, J. B. (2018). The evaluation of social innovation: A review and integration of the current empirical knowledge base. Evaluation, 24(2), 237 – 258. https://doi.org/10.1177/1356389018763242
Minary, L., Alla, F., Cambon, L., Kivits, J. et Potvin, L. (2018). Addressing complexity in population health intervention research: The context/intervention interface. Journal of Epidemiology and Community Health, 72(4), 319 – 323. https://doi.org/10.1136/jech-2017-209921. Medline:29321174
Mulgan, G. (2006). The process of social innovation. Innovations: Technology, Governance, Globalization, 1(2), 145 – 162. https://doi.org/10.1162/itgg.2006.1.2.145
Patton, M. Q. (1994). Developmental evaluation. Evaluation Practice, 15(3), 311 – 319. https://doi.org/10.1016/0886-1633(94)90026-4
Patton, M. Q. (1996). A world larger than formative and summative. Evaluation Practice, 17(2), 131–144. https://doi.org/10.1016/s0886-1633(96)90018-5
Patton, M. Q. (2003). Utilization-focused evaluation. Dans T. Kellaghan et D. L. Stuffle-beam (éds.), International handbook of educational evaluation (pp. 223 – 242). Dordrecht: Springer Netherlands.
Patton, M. Q. (2006). Evaluation for the way we work. Nonprofit Quarterly, 13.
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: The Guilford Press.
Patton, M. Q. (2015). State of the art and practice of developmental evaluation answers to common and recurring questions. Dans M. Q. Patton, K. McKegg et N. Wehipeihana (éds.), Developmental evaluation exemplars: Principles in practice (pp. 1–24). New York, NY: The Guilford Press.
Patton, M. Q. (2016). The developmental evaluation mindset: Eight guiding principles. Dans M. Patton, K. McKegg et N. Wehipeihana (éds.), Developmental evaluation exemplars: Principles in practice (pp. 289 – 312). New York, NY: The Guilford Press.
Pawson, R. et Tilley, N. (1997). Realistic evaluation. Thousand Oaks, CA: Sage.
Poth, C.-A., Pinto, D., et Howery, K. (2012). Addressing the challenges encountered during a developmental evaluation: Implications for evaluation practice. Canadian Journal of Program Evaluation, 26(1) , 39 – 48.
Preskill, H. et Beer, T. (2012). Evaluating social innovation. Washington, DC: Network Impact and Center for Evaluation Innovation.
Rey, L., Brousselle, A., Dedobbeleer, N. et Tremblay, M.-C. (2013). Les défis de l’évaluation développementale en recherche : une analyse d’implantation d’un Projet « Hôpital promoteur de santé ». Canadian Journal of Program Evaluation, 28(1) , 1 – 26.
Rey, L., Tremblay, M.-C. et Brousselle, A. (2014). Managing tensions between evaluation and research: Illustrative cases of developmental evaluation in the context of research. American Journal of Evaluation, 35(1), 45 – 60. https://doi.org/10.1177/1098214013503698
Schwab, J. (1978). Science, curriculum, and liberal education: Selected essays. Chicago, IL: University of Chicago Press.
Schwandt, T. A. (2003). “Back to the rough ground!” Beyond theory to practice in evaluation. Evaluation, 9(3), 353 – 364. https://doi.org/10.1177/13563890030093008
Searle, M., Merchant, S., Chalas, A. et Yan Lam, C. (2017). A case study of the guiding principles for collaborative approaches to evaluation in a developmental evaluation context. Canadian Journal of Program Evaluation, 31(3), 350 – 373. https://doi.org/10.3138/cjpe.328
Skolits, G. J., Morrow, J. A. et Burr, E. M. (2009). Reconceptualizing evaluator roles. American Journal of Evaluation, 30(3), 275–295. https://doi.org/10.1177/1098214009338872
Stern, J. A. C., Gavaghan, D. et Egger, M. (2000). Publication and related bias in metaanalysis: Power of statistical tests and prevalence in the literature. Journal of Clinical Epidemiology, 53(11), 1119 – 1129. https://doi.org/10.1016/s0895-4356(00)00242-0
Svensson, K., Szijarto, B., Milley, P. et Cousins, J. B. (2018). Evaluating social innovations: Implications for evaluation design. American Journal of Evaluation, 39(4), 458 – 477. https://doi.org/10.1177/1098214018763553
Szijarto, B. et Cousins, J. B. (2019). Mapping the practice of developmental evaluation: Insights from a concept mapping study. Evaluation and Program Planning, 76, 101666. https://doi.org/10.1016/j.evalprogplan.2019.05.001. Medline:31202116
Tremblay, M., Gokiert, R., Kingsley, B., Mottershead, K. et Pei, J. (2020). Using developmental evaluation and community-based participatory research to develop a model of supportive housing. Evaluation and Program Planning, 82, 101849. https://doi.org/10.1016/j.evalprogplan.2020.101849. Medline:32679353
Vincent, V., Rollin, J. et Harrisson, D. (2007). Acteurs et processus d’innovation sociale au Québec. Québec, QC: Université du Québec.
Weiss, C. H. (1998). Have we learned anything new about the use of evaluation? The American Journal of Evaluation, 19(1), 21 – 33. https://doi.org/10.1016/s10982140(99)80178-7
Westley, F. et Antadze, N. (2010). Making a difference: Strategies for scaling social innovation for greater impact. The Innovation Journal: The Public Sector Innovation Journal, 15(2), 1 – 19.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Pier-Luc Turcotte, Lynda Rey, Astrid Brousselle
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
