Intersections between Participatory Evaluation and Social Pedagogy When Assessing Socio-Educational Projects
DOI:
https://doi.org/10.3138/cjpe-2023-0049Keywords:
intersections, participatory evaluation, program evaluation, social pedagogy, socio-educational actionsAbstract
Social pedagogy is a science, a practice, and an art that was born from the need to provide an educational response to sociocultural situations and problems that confront individuals, groups, and communities. Participatory evaluation is a methodological strategy in which program evaluation is understood through the construction of shared knowledge, user participation, and collective decision-making. Although both social pedagogy and participatory evaluation have been variously defined in academic debates, an analysis of the intersection between the two is lacking. The main objective of this study is therefore to analyze the relationship and intersections between participatory approaches in evaluation and the scientific discipline of social pedagogy. To this end, a semi-structured questionnaire was designed to collect quantitative and qualitative data from 18 academics in seven countries. The results reveal the importance of eight pedagogical dimensions identified in the development of participatory evaluation, which are defined in this research. The study also discusses the potential and limitations of applying participatory evaluation to socio-educational projects. The aim of this research is to broaden the scientific debate on the intersection between social pedagogy and participatory evaluation, providing data that will improve the implementation of participatory evaluation in social pedagogy, thus encouraging greater user participation in this context.
References
Andrews, A. B. (2004). Start at the end: Empowerment evaluation product planning. Evaluation and Program Planning, 27(3), 275–285.
Aubel, J. (2008). Manual de evaluación participativa del programa: Involucrando a los participantes del programa en el proceso de evaluación, Catholic Relief Services and Child Survival Technical Support. Retrieved from http://pdf.usaid.gov/pdf_docs/PNACH758.pdf
Boadu, E. S., & Ile, I. (2019). Between power and perception: Understanding youth perspectives in participatory and evaluation (PMyE) in Ghana. Evaluation and Program Planning, 77(101683).
Brisolara, S. (1998). The history of participatory evaluation and current debates in the field. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation (pp. 25–41). Jossey Bass.
Cousins, J. B. (1996). Consequences of researchers’ involvement in participatory evaluation. Studies in Educational Evaluation, 22(1), 3–27.
Cousins, J. B. (2003). Utilization effects of participatory evaluation. In T. Kellaghan, D. L. Stufflebeam, & L. A. Wingate (Eds.), International handbook of educational evaluation (pp. 245–265). Klewer.
Cousins, J. B. (2005). Will the real empowerment evaluation please stand up? A critical friend perspective. In D. M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation principles in practice (pp. 183–208). Guilford Press.
Cousins, J. B. (Ed.) (2020). Collaborative approaches to evaluation: Principles in use. SAGE.
Cousins, J. B., & Chouinard, J. A. (2012). Participatory evaluation up close: An integration of research-based knowledge. Information Age.
Cousins, J. B., & Earl, L. (1992). The case for participatory evaluation. Educational Evaluation and Policy Analysis, 14(3), 397–418.
Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. In E. Whitmore (Ed.), Understanding and practicing participatory evaluation (pp. 3–23). Jossey-Bass.
Cullen, A. E., Coryn, C. L. S., & Rugh, J. (2011). The politics and consequences of including stakeholders in international development evaluation. American Journal of Evaluation, 32(3), 345–361.
Chouinard, J. A., Milley, P., & Cousins, J. B. (2014). Intersections between participatory evaluation and social pedagogy. Pedagogia Social. Revista Interuniversitaria, 24, 137–162.
Daigneault, P-M., & Jacob, S. (2009). Toward accurate measurement of participation: Rethinking the conceptualization and operationalization of participatory evaluation. American Journal of Evaluation, 13(3), 371–386.
DeLuca, C., Poth, Ch., & Searle, M. (2009). Evaluation for learning: A cross-case analysis of evaluator strategies. Studies in Educational Evaluation, 35, 121–129.
Eriksson, L. (2014). Understandings of social pedagogy from northern European perspectives. Journal of Social Work, 14(2), 165–182.
Exner-Cortens, D., Sitter, K. C., Van Bavel, M., & Wright, A. (2021) Photo-based evaluation: A method for participatory evaluation with adolescents. American Journal of Evaluation, 43(1), 1–16.
Fetterman, D. M. (2001a). Foundations of empowerment evaluation. SAGE.
Fetterman, D. M. (2001b). The transformation of evaluation into a collaboration: A vision of evaluation in the 21st century. American Journal of Evaluation, 22(3), 381–385.
Fetterman, D. M., & Wandersman, A. (Eds.) (2005). Empowerment evaluation principles in practice. Guilford Press.
Fetterman, D. M., & Wandersman, A. (2007). Empowerment evaluation: Yesterday, today and tomorrow. American Journal of Evaluation, 28(2), 179–198.
Frampton, M. (2022). The spirit of social pedagogy: The alternative theory base of German child welfare. Critical and Radical Social Work, 12(1), 58–74.
Halsall, T., Daley, M., Hawke, L., & Henderson, J. (2021). Exploring peer support services for youth experiencing multiple health and social challenges in Canada: A hybrid realist-participatory evaluation model. International Journal of Qualitative Methods, 20, 1–13.
Hämäläinen, J. (2013). Defining social pedagogy: Historical, theoretical and practical considerations. British Journal of Social Work, 45(3), 1–17.
Hämäläinen, J., & Eriksson, L. (2016). Social pedagogy in Finland and Sweden: A comparative analysis. Pedagogía Social. Revista Interuniversitaria, 27, 71–93.
House, E. R. (2005). Promising practice: The many forms of democratic evaluation. Evaluation Exchange, 11(3), 7.
Huan, N. H., Thiet, L. V., Chien, H. V., & Heong, K. L. (2005). Farmers’ participatory evaluation of reducing pesticides, fertilizers and seed rates in rice farming in the Mekong Delta, Vietnam. Crop Protection, 24(5), 457–464.
Janer, À., & Úcar, X. (2017). Analysing the dimensions of social pedagogy from an international perspective. European Journal of Social Work, 20(2), 203–218.
Janer, À., & Úcar, X. (2020). Social pedagogy in the world today: An analysis of the academic, training and professional perspectives. British Journal of Social Work, 3(50), 701–721.
Kornbeck, J., & Rosendal, N. (2011). Introduction to volume I (Theories, Childhood, Youth). In J. Kornbeck & N. Rosendal Jensen (Eds.), Social pedagogy for the entire lifespan: Vol. 1, Theories, childhood, youth. Europäischer Hochschulverlag GmbH, KG.
Kornbeck, J., & Úcar, X. (Eds.). (2015). Latin American social pedagogy: Relaying concepts, values and methods between Europe and the Americas. EVH/Academicpress GmbH.
Laperrière, H., Potvin, L., & Zúñiga, R. (2012). A socio-political framework for evaluability assessment of participatory evaluations of partnerships: Making sense of the power differentials in programs that involve the state and civil society. Evaluation, 18(2), 246–259.
Lorenz, W. (2008). Paradigms and politics: Understanding methods paradigms in an historical context: the case of social pedagogy. British Journal of Social Work, 38, 625–644.
Mátel, A., & Preissová, A. (2016). Convergent and divergent aspects of social work and social pedagogy. Časopis Sociální pedagogika, 1(4), 72–86.
Morabito, S. M. (2002). Evaluator roles and strategies for expanding evaluation process influence. American Journal of Evaluation, 23, 321–330.
Nuñez, H. (2015). Evaluación participativa en la acción comunitaria: Aproximaciones teórica y metodológica. Popular.
Nuñez, H., Crespo, E., Llena-Berñe, A., & Úcar, X. (2014). Enfoques de evaluación orientados a la participación en los procesos de acción comunitaria. Pedagogía Social. Revista Interuniversitaria, 24, 79–103.
Nuñez, H., & Úcar, X. (2018). L’avaluació participativa d’accions comunitàries: Una bateria de dimensions i evidències de treball per a professionals i agents socials. Educació social: Revista d’intervenció sòcioeducativa, 68, 143–164.
Nuñez, H., Llena-Berñe, A., Fabra-Fres, N., & Gómez-Serra, M. (2021). Participatory action research and participatory evaluation: Analysis of two methodological approaches to promote youth agency and participation. Revista de Cercetare si Interventie Sociala, 75, 28–52.
O’Sullivan, R. G. (2012). Collaborative evaluation within a framework of stakeholder-oriented evaluation approaches. Evaluation and Program Planning, 35(4), 518–522.
Patton, M. Q. (2008). Utilization-focused evaluation: The new century text (4th ed.). SAGE.
Patton, M. Q. (2012). A utilization-focused approach to contribution analysis. Evaluation, 18(3), 364–377.
Patton, M. Q. (2017). Pedagogical principles of evaluation: Interpreting Freire. Pedagogy of Evaluation, 2017(155), 49–77.
Plottu, B., & Plottu, E. (2009). Approaches to participation in evaluation: Some conditions for implementation. Evaluation, 15(3), 343–359.
Plottu, B., & Plottu, E. (2011). Participatory evaluation: The virtues for public governance, the constraints on implementation. Group Decision and Negotiation, 20, 805–824.
Preskill, H., & Torres, R. T. (1999). Building capacity for organizational learning through evaluative inquiry. Evaluation, 5(1), 42–60.
Richards-Schuster, K., Wernick, L. J., Henderson, M., Bakko, M., Rodríguez, M. A., & Moore, E. (2021). Engaging youth voices to address racial disproportionality in schools: Exploring the practice and potential of youth participatory research in an urban district. Children and Youth Services Review, 122, 1–9.
Ribas Machado, E. (2013). O desenvolvimento da pedagogia social sobre a perspectiva comparada: estágio atual no contexto iberoamericano (Unpublished dissertation, Universidad de São Paulo, Brazil). Retrieved from https://www.teses.usp.br
Rodríguez-Campos, L. (2005). Collaborative evaluation: A step by step model for the evaluator. Llumina Press.
Rodríguez-Campos, L. (2012). Advances in collaborative evaluation. Evaluation and Program Planning, 35(4), 523–528.
Sharkey, S., & Sharples, A. (2008). From the beginning: Negotiation in community evaluation. Evaluation, 14(3), 363–380.
Suárez-Herrera, J. C., Springett, J., & Kagan, K. (2009). Critical connections between participatory evaluation, organizational learning and intentional change in pluralistic organizations. Evaluation, 15(3), 321–342.
Tapella, E., Rodríguez-Bilella, P., Sanz, J. C., Chavez-Tafur, J., & Espinosa-Fajardo, J. (2021). Siembra y cosecha: Manual de evaluación participative. Instituto Alemán de Evaluación de la Cooperación para el Desarrollo (Deval).
Úcar, X. (2022). Theoretical and practical knowledge in social pedagogy: Levels and agents of the pedagogical knowledge production. Oxford Review of Education, 48(6), 767–785.
Úcar, X., Llena, A., Pescador, R., & Jiménez, J. (2018). Evaluación participativa de los procesos de evaluación del acompañamiento socioeducativo de jóvenes en medio abierto. Revista de Educación Social, 27, 1–23.
Úcar, X., Planas, A., Novella, A., & Rodrigo-Moriche, P. (2017). Participatory evaluation of youth empowerment in youth groups: Cases analysis. Pedagogía Social. Revista Interuniversitaria, 30, 67–80.
Zúñiga, R. (2000). La evaluación comunitaria: Contextos éticos y políticos. Cuadernos de Trabajo Social, 13, 211–229.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Héctor Núñez, Àngela Janer Hidalgo, Carolina Molina Palencia
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
