Practice Notes from a Participatory Impact Evaluation of a Leadership Development Program for People Living with HIV

Authors

  • Janice Duddy Pacific AIDS Network. Vancouver, British Columbia
  • Mona Lee Pacific AIDS Network. Vancouver, British Columbia
  • Paul Kerber Pacific AIDS Network. Vancouver, British Columbia
  • Alfiya Battalova Pacific AIDS Network. Vancouver, British Columbia
  • Elayne McIvor Catalyst Consulting, Ontario

DOI:

https://doi.org/10.3138/cjpe.68386

Keywords:

evaluation community, evaluation methods, program evaluation, stakeholders

Abstract

Interest in participatory evaluation and other collaborative inquiry approaches has risen substantially over the past few decades. However, there appears to be a lack of practical information about using and applying participatory evaluation approaches on the ground. This Practice Note uses a participatory impact evaluation of a leadership development program for people living with HIV and findings from a meta-evaluation of this work to describe the participatory evaluation approach adopted, challenges and lessons learned related to conducting a participatory evaluation, and some key factors and implications to consider for maximizing the success of future participatory evaluations.

References

AHA Centre. (2018). AHA centre fact sheet: Capacity bridging. http://www.ahacentre.ca/uploads/9/6/4/2/96422574/capacity_bridging_-_finaljune_2018.pdf

Chouinard, J. A., & Cousins, J. B. (2015). The journey from rhetoric to reality: Participatory evaluation in a development context. Educational Assessment, Evaluation and Accountability, 27(1), 5 – 39. https://doi.org/10.1007/s11092-013-9184-8

Cooper, S. (2017). Participatory evaluation in youth and community work: Theory and practice. Routledge.

Cousins, J. (2003). Utilization effects of participatory evaluation. In T. Kellaghan & D. L. Stufflebeam (Eds.), International handbook of educational evaluation: Part one: Perspectives/Part two: Practice (pp. 245 -265). Springer. https://www.springer.com/gp/book/9781402008498

Cousins, J. B., & Chouinard , J. A. (2012). Participatory evaluation up close: An integration of research-based knowledge. IAP.

Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 1998(80), 5 – 23. https://doi.org/10.1002/ev.1114

Duddy, J. (2017). Peer evaluator training manual. Pacific AIDS Network. https://pacificaidsnetwork.org/files/2017/04/PEEREVALUATORTRAININGPROGRAMFINAL-APRIL-2017-Merged.pdf

Estrella, M., Blauert, J., Gonsalves, J., Campilan, D., Gaventa, J., Guijt, I., . . . Ricafort, R. (Eds.). (2000). Learning from change: Issues and experiences in participatory monitoring and evaluation. International Development Research Centre.

Fawcett, S. B., Boothroyd, R., Schultz, J. A., Francisco, V. T., Carson, V., & Bremby, R. (2003). Building capacity for participatory evaluation within community initiatives. Journal of Prevention & Intervention in the Community, 26(2), 21 – 36. https://doi.org/10.1300/J005v26n02_03

Guta, A., Flicker, S., & Roche, B. (2013). Governing through community allegiance: A qualitative examination of peer research in community-based participatory research. Critical Public Health, 23(4), 432 – 451. https://doi.org/10.1080/09581596.2012.761675. Medline:24273389

King, J. A., Cousins, J. B., & Whitmore, E. (2007). Making sense of participatory evaluation: Framing participatory evaluation. New Directions for Evaluation, 2007(114), 83 – 105. https://doi.org/10.1002/ev.226

MacKinnon, S. (2018). Practising community-based participatory research: Stories of engagement, empowerment, and mobilization. Purich Books.

McIvor (Vlahaki), E. (2017). Meta evaluation: Positive leadership development institute impact evaluation. Pacific AIDS Network. https://pacificaidsnetwork.org/files/2018/01/Final-PLDI-Meta-Evaluation-Report-Midpoint-and-Project-End-FINAL.pdf

Pacific AIDS Network (PAN). (2018). PAN’s checklist: What do you need to have in place in order to be successful using a participatory evaluation approach? https://pacificaidsnetwork.org/files/2018/11/Participatory-approach-to-evaluation-CESBC-2018-Checklist-4.0.pdf

Rhodes, S. D., Vissman, A. T., Stowers, J., Miller, C., McCoy, T. P., Hergenrather, K. C., . . . Eng , E. (2011). A CBPR partnership increases HIV testing among men who have sex with men (MSM): Outcome findings from a pilot test of the CyBER/testing internet intervention. Health Education & Behavior, 38(3), 311 – 320. https://doi.org/10.1177/1090198110379572. Medline:21393625

Rice, M., & Franceschini, M. C. (2007). Lessons learned from the application of a participatory evaluation methodology to Healthy Municipalities, Cities and Communities initiatives in selected countries of the Americas. Promotion & Education, 14(2), 68 – 73. https://doi.org/10.1177/10253823070140021501. Medline:17665701

Smits, P. A., & Champagne, F. (2008). An assessment of the theoretical underpinnings of practical participatory evaluation. American Journal of Evaluation, 29(4), 427 – 442. https://doi.org/10.1177/1098214008325023

Souleymanov, R., Kuzmanović, D., Marshall, Z., Scheim, A. I., Mikiki, M., Worthington, C., & Millson, M . (2016). The ethics of community-based research with people who use drugs: Results of a scoping review. BMC Medical Ethics, 17(1), 25. https://doi.org/10.1186/s12910-016-0108-2. Medline:27129927

Suarez-Balcazar, Y., & Harper, G. (2014). Empowerment and participatory evaluation of community interventions: Multiple benefits. Routledge. https://doi.org/10.4324/9781315808703

Torres, R. T., Stone, S. P., Butkus, D. L., Hook, B. B., Casey, J., & Arens, S. A. (2000). Dialogue and reflection in a collaborative evaluation: Stakeholder and evaluator voices. New Directions for Evaluation, 85, 27. https://doi.org/10.1002/ev.1159

Zukoski, A. P., Bosserman, C., & Baechler, C. (2018). Essentials of participatory evaluation. In D. M. Fetterman, L. Rodríguez-Campos, A. P. Zukoski, & Contributors (Eds.), Collaborative, participatory, and empowerment evaluation: Stakeholder involvement approaches. The Guilford Press.

Downloads

Published

2023-04-21

How to Cite

Duddy, J., Lee, M., Kerber, P., Battalova, A., & McIvor, E. (2023). Practice Notes from a Participatory Impact Evaluation of a Leadership Development Program for People Living with HIV. Canadian Journal of Program Evaluation, 36(2), 236–245. https://doi.org/10.3138/cjpe.68386

Issue

Section

Research and Practice Notes