Creating Effectiveness Principles for Principles-Focused Developmental Evaluations in Health-Care Initiatives

Lessons Learned from Three Cases in British Columbia

Authors

  • Ihoghosa Iyamu Centre for Health Evaluation and Outcome Sciences (CHEOS) / University of British Columbia, Vancouver, British Columbia
  • Mai Berger Centre for Health Evaluation and Outcome Sciences (CHEOS) / University of British Columbia, Vancouver, British Columbia
  • Erika Ono Centre for Health Evaluation and Outcome Sciences (CHEOS) / University of British Columbia, Vancouver, British Columbia
  • Amy Salmon Centre for Health Evaluation and Outcome Sciences (CHEOS) / University of British Columbia, Vancouver, British Columbia

DOI:

https://doi.org/10.3138/cjpe.70804

Keywords:

developmental evaluation, effectiveness principles, principles-focused evaluation, utilization-focused evaluation

Abstract

Principles-focused developmental evaluation is an emergent method of evaluation that is increasingly achieving relevance in initiatives seeking to transform health-care delivery within complex-adaptive systems. Creating meaningful effectiveness principles is considered a crucial first step in setting up such evaluations. In this article, we describe four practical steps that we applied in defining effectiveness principles to align with Patton’s GUIDE criteria. To illustrate our approach, this article features three principles-focused developmental evaluations implemented in British Columbia, highlighting lessons learned through the process of creating effectiveness principles.

References

Bower, P., & Gilbody, S. (2005). Stepped care in psychological therapies: Access, effectiveness and efficiency. British Journal of Psychiatry, 186(1), 11 – 17. https://doi.org/10.1192/bjp.186.1.11

Centers for Disease Control and Prevention. (2011, October). Self-study guide: Program evaluation. Program Performance and Evaluation Office (PPEO).

Cole, D. C., Aslanyan, G., Dunn, A., Boyd, A., & Bates, I. (2014). Dilemmas of evaluation: Health research capacity initiatives. Bulletin of the World Health Organization, 92(12), 920 – 921. https://doi.org/10.2471/blt.14.141259

Dozois, E., Langlois, M., & Blanchet-Cohen, N. (2010). A practitioner’s guide to developmental evaluation. International Institute for Child Rights and Development.

Kinarsky, A. R., Alkin, M. C., & Christie, C. A. (2019). What have we learned? New Directions for Evaluation, 2019(163), 83 – 93. https://doi.org/10.1002/ev.20372

Lambert, E. Y., Rebecca, S., Ashery, D. S. W., Richard, H., & Needle, M. P. H. (1995). Qualitative methods in drug abuse and HIV research. Public Health Service National Institutes of Health National Institute on Drug Abuse Division of Epidemiology and Prevention Research.

Miles, A., & Asbridge, J. (2013). Contextualizing science in the aftermath of the evidence-based medicine era: On the need for person-centered healthcare. European Journal for Person Centered Healthcare, 1(2), 285. https://doi.org/10.5750/ejpch.v1i2.827

Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. Guilford Press.

Patton, M. Q. (2016). What is essential in developmental evaluation? On integrity, fidelity, adultery, abstinence, impotence, long-term commitment, integrity, and sensitivity in implementing evaluation models. American Journal of Evaluation, 37(2), 250 – 265. https://doi.org/10.1177/1098214015626295

Patton, M. Q. (2018). Principles-focused evaluation: The guide. Guilford Press.

Patton, M. Q., Mckegg, K., & Wehipeihana, N. (Eds.). (2015). Developmental evaluation exemplars: Principles in practice. Guilford Press.

Salmon, A., Fernando, S., & Berger, M. (2018). Developmental evaluation of Foundry’s proof of concept.

Turner, R. E., & Cromhout, P. B. (2020). Case study used to guide the development of effectiveness principles for Principles-Focused Evaluation. African Evaluation Journal, 8(1), 1 – 6. https://doi.org/10.4102/aej.v8i1.416

Wolfe, S. M., Long, P. D., & Brown, K. K. (2020). Using a principles-focused evaluation approach to evaluate coalitions and collaboratives working toward equity and social justice. New Directions for Evaluation 165, 45 – 65. https://doi.org/10.1002/ev.20404

Downloads

Published

2023-04-21

How to Cite

Iyamu, I., Berger, M., Ono, E., & Salmon, A. (2023). Creating Effectiveness Principles for Principles-Focused Developmental Evaluations in Health-Care Initiatives: Lessons Learned from Three Cases in British Columbia. Canadian Journal of Program Evaluation, 36(1), 64–81. https://doi.org/10.3138/cjpe.70804

Issue

Vol. 36 No. 1 (2021): Spring

Section

Articles

License

Copyright (c) 2021 Ihoghosa Iyamu, Mai Berger, Erika Ono, Amy Salmon

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.

Authors retain copyright of their work and grant the journal right of first publication.

Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.