Causality and Complexity in Evaluating Equity Interventions
Conceptual Issues That Need to Be Addressed in Theory-Driven Evaluation Approaches
DOI:
https://doi.org/10.3138/cjpe.75430Keywords:
theory of change, causal pathways, inequities, pluralistic causation, Contribution AnalysisAbstract
We discuss how explicit thinking about a variety of causal pathways, informed by a dynamic systems lens that is responsible for exacerbating and diminishing inequities as well as different types of complexities (related to program pathways), will further help develop theory-driven evaluation approaches such as Contribution Analysis. We argue that contribution claims associated with interventions focused on addressing inequities need to consider the multiple types of causal pathways by which a program can help reduce inequities.
References
Bowleg, L. (2020). We’re Not All in This Together: On COVID-19, Intersectionality, and Structural Inequality. American Journal of Public Health, 110(7), 917.
Campbell, D. T. (1984). Can we be scientific in applied social science? In R. F. Connor, D. G. Altman, & C. Jackson (Eds.), Evaluation studies review annual (Vol. 9, pp. 26–48). Newbury Park, CA: Sage.
Carey, G., & Crammond, B. (2015). Systems change for the social determinants of health. BMC Public Health, 15(1), 662. Medline:26168785
Cartwright, N. (2007). Hunting causes and using them: Approaches in philosophy and economics. Cambridge: Cambridge University Press.
Cartwright, N., & Hardie, J. (2012). Evidence-based policy: Doing it better. A practical guide to predicting if a policy will work for you. Oxford, England: Oxford University Press.
Costanza, R. (2014). A theory of socio-ecological system change. Journal of Bioeconomics, 16(1), 39–44.
Davidoff, F. (2017). Can knowledge about heterogeneity in treatment effects help us choose wisely? Annals of Internal Medicine, 166(2), 141–142. Medline:27820948
Earl, S., Carden, F., & Smutylo, T. (2001). Outcome mapping: Building learning and reflection into development programs. Ottawa, Canada: IDRC.
Foster-Fishman, P. G., & Droege, E. (2010). Locating the system in a system of care. Evaluation and Program Planning, 33(1), 11–13. Medline:19850341
Homes First (2021). About Toronto Homelessness. Retrieved from https://homesfirst.on.ca/about-toronto-homelessness/
Koleros, A., & Mayne, J. (2019). Using actor-based theories of change to conduct robust contribution analysis in complex settings. Canadian Journal of Program Evaluation, 33(3), 292–315.
Leeuw, F. L. (2023). John Mayne and rules of thumb for contribution analysis: A comparison with two related approaches. Canadian Journal of Program Evaluation, 37(3), 403–421.
Mackie, J. L. (1974). The cement of the universe: A study of causation. Oxford, England: Oxford University Press.
Mayne, J. (2012). Contribution analysis: Coming of age? Evaluation, 18(3), 270–280.
Mayne, J. (2019). Revisiting contribution analysis. Canadian Journal of Program Evaluation, 34(2), 171–191.
Mayne, J., & Johnson, N. (2015). Using theories of change in the CGIAR Research Program on Agriculture for Nutrition and Health. Evaluation, 21(4), 407–428.
Montague, S., & Porteous, N. L. (2013). The case for including reach as a key element of program theory. Evaluation and Program Planning, 36(1), 177–183. Medline:22607710
Palenberg, M. A. (2023). Causal claims in contribution analysis. Canadian Journal of Program Evaluation, 37(3), 389–402.
Pawson, R. (2008). Causality for beginners. ESRC/NCRM Research Methods Festival. Retrieved from https://eprints.ncrm.ac.uk/id/eprint/245/
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004). Realist synthesis: an introduction. ESRC Res Methods Program, 2. Retrieved from http://www.ccsr.ac.uk/methods/publications/RMPmethods2.pdf
Singer, M. (1994). AIDS and the health crisis of the US urban poor; the perspective of critical medical anthropology. Social Science & Medicine, 39(7), 931–948.
Singer, M., & Snipes, C. (1992). Generations of suffering: Experiences of a treatment program for substance abuse during pregnancy. Journal of Health Care for the Poor and Underserved, 3(1), 222–234.
Sridharan, S., & Gillespie, D. (2004). Sustaining problem-solving capacity in collaborative networks. Criminology & Public Policy, 3(2), 221–250.
Sridharan, S., & Nakaima, A. (2012). Towards an evidence base of theory-driven evaluations: Some questions for proponents of theory-driven evaluation. Evaluation, 18(3), 378–395.
Sridharan, S., & Nakaima, A. (2019). Till time (and poor planning) do us part: Programs as dynamic systems—Incorporating planning of sustainability into theories of change. Canadian Journal of Program Evaluation, 33(3).
Wolkenhauer, O., & Hofmeyr, J. H. S. (2007). An abstract cell model that describes the self-organization of cell function in living systems. Journal of theoretical biology, 246(3), 461–476. Medline:17328919
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Sanjeev Sridharan, April Nakaima, Amanda Pereira
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
