Collaborative Evaluation Frameworks for Indigenous-Led Community Health Interventions
A Narrative Review
DOI:
https://doi.org/10.3138/cjpe.71349Keywords:
chronic disease, evaluation approaches, Indigenous, interventions, telehealth, WesternAbstract
This narrative review highlights evaluation approaches, principles, and frameworks for chronic disease interventions in North American Indigenous contexts. It aims to inform the co-development of an evaluation framework for two studies focused on improving diabetes and obesity outcomes for urban Indigenous communities. This review uses a Two-Eyed Seeing perspective that brings Indigenous and Western ways of being, knowing, and doing together. There is a paucity of published evaluation frameworks inclusive of both perspectives. The themes identified here suggest that evaluation approaches should address gender equity issues, be participatory, be grounded in local context, traditions, and knowledge, and be responsive to community-identified needs and solutions.
References
Acree , J. , & Chouinard , J. A. (2020). Exploring use and infuence in culturally responsive approaches to evaluation: A review of the empirical literature. American Journal of Evaluation, 41(2), 201 – 215 . https://doi.org/10.1177/1098214019879505
Allen, L., Hatala, A., Ijaz, S., Courchene, D., & Bushie , B. (2020). Indigenous-led health care partnerships in Canada. Canadian Medical Association Journal, 192(9), E208 – E216. https://doi.org/10.1503/cmaj.190728. Medline:32122977
Bainbridge, R., Tsey, K., McCalman, J., Kinchin, I., Saunders, V., Lui , F. W., . . . Lawson , K. (2015). No one’s discussing the elephant in the room: Contemplating questions of research impact and beneft in Aboriginal and Torres Strait Islander Australian health research. BMC Public Health, London, 15(1). https://doi.org/10.1186/s12889015-2052-3. Medline:26202429
Bamberger , M. , & Segone , M. (2011). How to design and manage equity-focused evaluations. UNICEF Evaluation Office. https://evalpartners.org/sites/default/fles/EWP5_Equity_focused_evaluations.pdf
Banna, J., & Bersamin, A. (2018). Community involvement in design, implementation and evaluation of nutrition interventions to reduce chronic diseases in indigenous populations in the U.S.: A systematic review. International Journal for Equity in Health, 17(1). https://doi.org/10.1186/s12939-018-0829-6. Medline:30103753
Bartlett, C. , Marshall , M. , & Marshall , A. (2012). Two-Eyed Seeing and other lessons learned within a co-learning journey of bringing together Indigenous and mainstream knowledges and ways of knowing . Journal of Environmental Studies and Sciences, 2(4), 331 – 340. https://doi.org/10.1007/s13412-012-0086-8
Better Evaluation Ltd. (2011). Approaches. BetterEvaluation. https://www.betterevaluation.org/en/approaches
Bremner, L. (2019). Creating new stories: The role of evaluation in truth and reconciliation. Canadian Journal of Program Evaluation, 34(2). https://doi.org/10.3138/cjpe.67976
Chandna, K., Vine, M. M., Snelling, S., Harris, R., Smylie, J., & Manson, H. (2019). Principles, approaches, and methods for evaluation in Indigenous contexts: A grey literature scoping review. Canadian Journal of Program Evaluation, 34(1). https://doi.org/10.3138/cjpe.43050
Chouinard , J. A. , & Cousins , J. B. (2007). Culturally competent evaluation for Aboriginal communities: A review of the empirical literature. Journal of Multidisciplinary Evaluation, 4(8), 18 .
Dudgeon, P., Bray, A., Darlaston-Jones, D., & Walker, R. (2020). Aboriginal participatory action research: An Indigenous research methodology strengthening decolonisation and social and emotional wellbeing: Discussion paper and literature review. Lowitja Institute. https://www.lowitja.org.au/content/Document/Lowitja-Publishing/LI_Discussion_Paper_P-Dudgeon_FINAL3.pdf
Firestone , M. ( 2020 ). Indigenous health service: Principles and guidelines from a provincial “three ribbon” expert panel. Canadian Journal of Program Evaluation, 34(3). https://doi.org/10.3138/cjpe.68831
Gillespie , J. , Albert , J. , Grant , S. , & MacKeigan , T. (2020). Missing in action: Indigenous knowledge systems in evaluation of comprehensive community initiatives . Canadian Journal of Program Evaluation, 36(1), 18. https://doi.org/10.3138/cjpe.69099
Given, L. M. (Ed.). (2008). The Sage encyclopedia of qualitative research methods. Sage .
Goforth, A. N., Nichols, L. M., Sun, J., Violante, A., Christopher, K., & Graham, N. (2021). Incorporating the Indigenous evaluation framework for culturally responsive community engagement. Psychology in the Schools. https://doi.org/10.1002/pits.22533
Grover, J. G. (2010). Challenges in applying Indigenous evaluation practices in mainstream grant programs to Indigenous communities. The Canadian Journal of Program Evaluation, 23(2), 33 – 50 .
Hayward , M. N. , Pace , R. , Zaran , H. , Dyck , R. , Hanley , A. J. , Green , M. E. , . . . Harris , S. B. (2020). Closing the Indigenous health gap in Canada: Results from the TransFORmation of IndiGEnous PrimAry HEAlthcare Delivery (FORGE AHEAD) program . Diabetes Research and Clinical Practice, 162, 108066 . https://doi.org/10.1016/j.diabres.2020.108066. Medline:32045618
Hayward, M. N., Paquette-Warren, J., & Harris, S. B. (2016). Developing community-driven quality improvement initiatives to enhance chronic disease care in Indigenous communities in Canada: Te FORGE AHEAD program protocol. Health Research Policy and Systems, 14(1), 55 . https://doi.org/10.1186/s12961-016-0127-y. Medline:27456349
Heggie , K. (2018). Indigenous wellness indicators: Including urban Indigenous wellness indicators in the Healthy City Strategy. City of Vancouver. https://sustain.ubc.ca/sites/default/fles/2018-62%20Indigenous%20Wellness%20Indicators_Heggie.pdf
Iwama, M., Marshall, M., Marshall, A., & Bartlett, C. (2009). Two-Eyed Seeing and the language of healing in community-based research. Canadian Journal of Native Education, 32(2), 3 – 23 .
Jull, J. , Giles, A. , & Graham, I. D. (2017). Community-based participatory research and integrated knowledge translation: Advancing the co-creation of knowledge. Implementation Science, 12(1), 150. https://doi.org/10.1186/s13012-017-0696-3. Medline:29258551
Kurtz, D. L. M. (2013). Indigenous methodologies: Traversing Indigenous and Western worldviews in research. AlterNative: An International Journal of Indigenous Peoples, 9(3), 217 – 229. https://doi.org/10.1177/117718011300900303
Kurtz, D. L. M., Turner, D. , Nyberg, J. , & Moar, D. (2014). Social justice and health equity: Urban aboriginal women’s action for health reform. International Journal of Health, Wellness, and Society, 3(4), 13 – 26 . https://doi.org/10.18848/2156-8960/cgp/v03i04/41081
LaFrance , J. , & Nichols , R. (2010). Reframing evaluation: Defning an Indigenous evaluation framework. Canadian Journal of Program Evaluation, 23(2), 13 – 31.
Lawrence, T. J. , & James, R. D. (2019). Good health and wellness: Measuring impact through an Indigenous lens . Preventing Chronic Disease, 16, 180655. https://doi.org/10.5888/pcd16.180655. Medline:31418684
Maar , M., Yeates, K., Barron, M., Hua, D., Liu , P., Lum-Kwong , M. M., . . . Tobe , S. W. ( 2015). I-RREACH: An engagement and assessment tool for improving implementation readiness of researchers, organizations and communities in complex interventions .
Implementation Science, 10(1), 64 – 77. https://doi.org/10.1186/s13012-015-0257-6. Medline:25935849
Maar , M. A. , Yeates , K. , Perkins , N. , Boesch , L. , Hua-Stewart , D. , Liu , P. , . . . Tobe , S. W. (2017). A framework for the study of complex mHealth interventions in diverse cultural settings . JMIR MHealth and UHealth, 5(4), e47 . https://doi.org/10.2196/mhealth.7044. Medline:28428165
McKinley, G. (2020). Reflections on being a learner: The value of relationship-based community evaluations in Indigenous communities . Canadian Journal of Program Evaluation, 34(3), 464 . https://doi.org/10.3138/cjpe.68857
National Collaborating Centre for Aboriginal Health (NCCAH). (2013). Indigenous approaches to program evaluation. https://www.nccih.ca/docs/context/FS-IndigenousApproachesProgramEvaluation-EN.pdf
Plamondon, K. M. (2020). A tool to assess alignment between knowledge and action for health equity. BMC Public Health, 20(1), 224 . https://doi.org/10.1186/s12889-020-8324-6. Medline:32050946
Reciprocal Consulting. (2011). Sage advice: Real-world approaches to program evaluation in Northern, remote and aboriginal communities. The Capture Project and Canadian Partnership against Cancer. https://static1.squarespace.com/static/5763a7c5893fc07fb7f03a38/t/577172a9893fc09ddd5517b6/1467052722328/2-Sage-Advice-English.pdf
Saini, M. (2017). Participatory methods for Inuit public health promotion and programme evaluation in Nunatsiavut, Canada . International Journal of Circumpolar Health, 76(1),1343637. https://doi.org/10.1080/22423982.2017.1343637. Medline:28691646
Shepherd , R. P. , & Graham , K. A. H. (2020). Identifying key epistemological challenges evaluating in Indigenous contexts: Achieving Bimaadiziwin through Youth Futures. Canadian Journal of Program Evaluation, 34(3), 442 . https://doi.org/10.3138/cjpe.68866
Tremblay , M.-C. , Martin , D. H. , McComber , A. M. , McGregor , A. , & Macaulay , A. C. (2018). Understanding community-based participatory research through a social movement framework: A case study of the Kahnawake Schools Diabetes Prevention Project . BMC Public Health, 18(1), 487 . https://doi.org/10.1186/s12889-018-5412-y. Medline:29650020
Tricco , A. C. , Lillie , E. , Zarin , W. , O’Brien , K. K. , Colquhoun , H. , Levac , D. , . . . Straus , S. E. (2018). PRISMA extension for Scoping Reviews (PRISMA-ScR): Checklist and explanation . Annals of Internal Medicine, 169(7), 467 . https://doi.org/10.7326/m18-0850. Medline:30178033
Truth and Reconciliation Commission of Canada (TRC). (2015). Honouring the truth, reconciling for the future: Final report of the Truth and Reconciliation Commission of Canada. http://www.trc.ca/assets/pdf/Honouring_the_Truth_Reconciling_for_the_Future_July_23_2015.pdf
UNICEF. (2017). Gender equality: Glossary of terms and concepts . UNICEF Regional Office for South Asia. https://www.unicef.org/rosa/reports/gender-equality
World Health Organization, Regional Office for Europe, Health Evidence Network, European Observatory on Health Systems and Policies, & Payne, S. (2009). How can gender equity be addressed through health systems? https://apps.who.int/iris/handle/10665/107956
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Diana Gresku, Charlotte Jones, Donna L. M. Kurtz
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
