Relational Systems and the Principles of Self-Determination, Reciprocity, and Mutual Benefit
Enacting Indigenous Ways of Knowing in the Evaluation of an Indigenous Health Research Network in the Province of British Columbia, Canada
DOI:
https://doi.org/10.3138/cjpe-2024-0036Keywords:
Indigenous health research, Indigenous program assessment and evaluation, Indigenous priorities in evaluation, relational systems, self-determinationAbstract
The British Columbia Network Environment for Indigenous Health Research (BC NEIHR) is one of nine Canada-wide initiatives focused on research leadership across First Nations, Métis, and Inuit communities. When developing the BC NEIHR Environmental Evaluation Framework (EEF) the authors strove to empower Indigenous people to engage in evaluation that mirrors their cultural principles. With the aim of advancing their own evaluation, and contribute to Indigenous evaluation knowledge, the authors conducted a critical content analysis of the EEF and annual reports supported by an Indigenous evaluation literature scan. This article presents the results of that meta-analysis, in which four improvement themes where found: addressing power dynamics, using methods based on Indigenous epistemologies, redefining success metrics and indicators, and the idea of becoming rather than having done. The meta-analysis concludes that the key to Indigenous evaluation lies in relational systems thinking, self-determination, reciprocity, and mutual benefit. In this work, the authors hope to contribute to the future directions of Indigenous evaluation frameworks. This article is a contribution to the Canadian Journal of Program Evaluation Roots and Relations Collection’s Western Door – Do Good Work, with the aim of supporting and advancing culturally grounded, reciprocal, and relational Indigenous evaluation principles and processes.
References
British Columbia Network Environment for Indigenous Health Research [BC NEIHR], & Reciprocal Consulting. (2024). BC Network Environment for Indigenous Health Research Cumulative Impacts Report. BC NEIHR.
Canadian Institutes of Health Research. (2025). Network Environments for Indigenous Health Research (NEIHR). Retrieved February 23, 2025, from https://cihr-irsc.gc.ca/e/51161.html
Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council Canada, & Social Sciences and Humanities Research Council of Canada. (2014, December). Tri-Council policy statement: Ethical conduct for research involving humans. https://publications.gc.ca/collections/collection_2015/ger-pre/RR4-2-2014-eng.pdf
Cavino, H. M. (2013). Across the colonial divide: Conversations about evaluation in Indigenous contexts. American Journal of Evaluation, 34(3), 339–355.
Chandna, K., Vine, M. M., Snelling, S. J., Harris, R., Smylie, J., & Manson, H. (2019). Principles, approaches, and methods for evaluation in Indigenous contexts: A grey literature scoping review. Canadian Journal of Program Evaluation, 34(1), 21–47.
Chilisa, B., Major, T. E., Gaotlhobogwe, M., & Mokgolodi, H. (2016). Decolonizing and Indigenizing evaluation practice in Africa: Toward African relational evaluation approaches. Canadian Journal of Program Evaluation, 30(3), 313–328.
Clarke, G. S., Douglas, E. B., House, M. J., Hudgins, K. E. G., Campos, S., & Vaughn, E. E. (2022). Empowering Indigenous communities through a participatory, culturally responsive evaluation of a federal program for older Americans. American Journal of Evaluation, 43(4), 484–503.
Columbia University. (2024). Content analysis. https://www.publichealth.columbia.edu/research/population-health-methods/content-analysis#:∼:text=Content%20analysis%20is%20a%20research,words%2C%20themes%2C%20or%20concepts
Cram, F. (2018). Conclusion: Lessons about Indigenous evaluation. New Directions for Evaluation, 2018(159), 121–133.
De Goër De Herve, M. (2024). The transformational power of evaluation: Exploring long-term perspectives in evaluations of impacts and outcomes from the standpoint of practitioners. Evaluation, 30(4), 507–532.
DeLancey, D. (2020). Indigenous evaluation in the Northwest Territories: Opportunities and challenges. Canadian Journal of Program Evaluation, 34(3), 492–512.
Loppie, C., & Erb, T. (2022a). Evaluation framework: A supportive environment for Indigenous-led health research. BC NEIHR. https://www.sfu.ca/content/dam/sfu/bcneihr/Documents/TrainingResourcesDocuments/BCNEIHR_Evaluation_Framework_Final_created_2020.pdf
Loppie, C. & Erb, T. (2022b). Indigenous cultural safety in research framework. BC NEIHR. https://www.sfu.ca/content/dam/sfu/bcneihr/Documents/TrainingResourcesDocuments/Indigenous_Cultural_Safety_Framework.pdf
EvalIndigenous. (n.d.). EvalIndigenous about. Retrieved July 7, 2024, from https://www.evalindigenous.net/
Finlay, S., Judd, J., Roe, Y., Fredericks, B., Smith, J., Foley, D., Boulton, A., & Cargo, M. (2020). Decolonising the commissioning of Indigenous health and wellbeing program evaluations in Australia. European Journal of Public Health, 30(Suppl. 5), ckaa166.762.
George, C. (2022). Seeing through watcher’s eyes [Graphic]. https://prezi.com/view/qEBWAdZhSFWmPVpwWbLH/
Gillespie, J., Albert, J., Grant, S., & MacKeigan, T. (2020). Missing in action: Indigenous knowledge systems in evaluation of comprehensive community initiatives. Canadian Journal of Program Evaluation/La Revue Canadienne d Évaluation de Programme, 35(2), 170–187.
Goodchild, M. (2021). Relational systems thinking: That’s how change is going to come, from our Earth Mother. Journal of Awareness-Based Systems Change, 1(1), 75–103.
Goodchild, M. (2022). Relational systems thinking: The dibaajimowin (story) of re-theorizing “systems thinking” and “complexity science.” Journal of Awareness-Based Systems Change, 2(1), 53–76.
Government of Canada. (n.d.). Indigenous approaches to evaluation and research. Retrieved June 14, 2024, from https://www.justice.gc.ca/eng/rp-pr/jr/eiaer-eaame/approaches-approches.html
Gresku, D., Jones, C., & Kurtz, D. L. M. (2022). Collaborative evaluation frameworks for Indigenous-led community health interventions: A narrative review. Canadian Journal of Program Evaluation, 37(1), 19–42.
Grover, J. G. (2008). Challenges in applying Indigenous evaluation practices in mainstream grant programs to Indigenous communities. Canadian Journal of Program Evaluation, 23(2), 33–50.
Hassnain, H. (2023). Decolonizing evaluation: Truth, power, and the global evaluation knowledge base. Journal of MultiDisciplinary Evaluation, 19(44), 142–155.
Iseke, J. (2013). Indigenous storytelling as research. International Review of Qualitative Research, 6(4), 559–577.
Jacob, S., & Desautels, G. (2014). Assessing the quality of Aboriginal program evaluations. Canadian Journal of Program Evaluation, 29(1), 62–86.
Johnston-Goodstar, K. (2012). Decolonizing evaluation: The necessity of evaluation advisory groups in Indigenous evaluation. In R. VeLure Roholt & M. L. Baizerman (Eds.), Evaluation advisory groups (pp. 109–117). Jossey-Bass.
Kelly, L. M., & Htwe, P. P. T., (aka S.). (2024). Decolonizing community development evaluation in Rakhine State, Myanmar. American Journal of Evaluation, 45(1), 68–85.
Kineman, J. (2008). Fundamentals of relational complexity theory. Proceedings of the 52nd Annual Meeting of the ISSS, 3(1). https://journals.isss.org/index.php/proceedings52nd/article/view/1046
LaFrance, J., & Nichols, R. (2008). Reframing evaluation: Defining an Indigenous evaluation framework. Canadian Journal of Program Evaluation, 23(2), 13–31.
LaFrance, J., Nichols, R., & Kirkhart, K. (2012). Culture writes the script: On the centrality of context in indigenous evaluation. In D. J. Rog, J. L. Fitzpatrick, & R. F. Conner (Eds.), Context: A framework for its influence on evaluation practice (pp. 59–74). Jossey-Bass.
Lejano, R. P. (2019). Relationality and social–ecological systems: Going beyond or behind sustainability and resilience. Sustainability, 11(10), 2760.
Locklear, S., Hesketh, M., Begay, N., Brixey, J., Echo-Hawk, A., & James, R. (2023). Reclaiming our narratives: An Indigenous evaluation framework for urban American Indian/Alaska Native communities. Canadian Journal of Program Evaluation, 38(1), 8–26.
Maddox, R., Blais, G., Mashford-Pringle, A., Monchalin, R., Firestone, M., Ziegler, C., Ninomiya, M. M., & Smylie, J. (2021). Reviewing health service and program evaluations in Indigenous contexts: A systematic review. American Journal of Evaluation, 42(3), 332–353.
Martinez, A., Running Wolf, P., Subia BigFoot, D., Randall, C., & Villegas, M. (2018). The process of becoming: A roadmap to evaluation in Indian country. In F. Cram, K. A. Tibbetts, & J. LaFrance (Eds.), Indigenous evaluation (pp. 33–45). Wiley.
Martins, R. (Director). (2021, June 5). Visual metaphors are powerful building blocks for visual sense-making [Video]. YouTube. https://www.youtube.com/watch?v=-cOCAcB9fU0
McKegg, K. (2019). White privilege and the decolonization work needed in evaluation to support Indigenous sovereignty and self-determination. Canadian Journal of Program Evaluation, 34(2), 357–367
Meissner, S. N., Braithwaite, J., Thorne, K., Martinez, A., & Lycett, E. (2023). Indigenous feminist evaluation methods: A case study in “my two aunties.” Canadian Journal of Program Evaluation, 38(2), 186–207.
Mertens, D. M. (2010). Social transformation and evaluation. Evaluation Journal of Australasia, 10(2), 3–10.
Métis Centre, National Aboriginal Health Organization. (2010). Principles of ethical Métis research. National Aboriginal Health Organization. https://achh.ca/wp-content/uploads/2018/07/Guide_Ethics_NAHOMetisCentre.pdf
Nunavut Impact Review Board. (n.d.). Inuit Qaujimajatuqangit. Retrieved June 23, 2025, from https://www.nirb.ca/inuit-qaujimajatuqangit
Patton, M. Q. (2023). Evaluation for systems transformations. In P. Eliadis, I. A. Naidoo, & R. C. Rist (Eds.), Policy evaluation in the era of COVID-19 (pp. 183–205). Routledge.
Picciotto, R. (2023). Evaluation transformation implies its decolonization. Journal of MultiDisciplinary Evaluation, 19(44), 131–141.
Robinson, C. J., Kong, T., Coates, R., Watson, I., Stokes, C., Pert, P., McConnell, A., & Chen, C. (2021). Caring for Indigenous data to evaluate the benefits of Indigenous environmental programs. Environmental Management, 68(2), 160–169.
Shack, M. (2021). Indigenous perspectives in program evaluation: A scoping literature review exploring wise practices for program evaluation with Indigenous communities in northern Manitoba [Master of Arts in Indigenous Governance, University of Winnipeg]. WinnSpace.
Shepherd, R. P., & Graham, K. A. H. (2020). Evaluation in Indigenous contexts: An introduction to practice. Canadian Journal of Program Evaluation, 34(3), 391–399.
Svanberg, E. (2011). Can Indigenous research methodology (IRM) add to program evaluation methodology frameworks? [Master’s Thesis, The University of Queensland]. UQ eSpace.
Waapalaneexkweew, & Dodge-Francis, C. (2018). Culturally responsive Indigenous evaluation and Tribal governments: Understanding the relationship. New Directions for Evaluation, 2018(159), 17–31.
Wagamese, R. (2019). One drum: Stories and ceremonies for a planet. Douglas & McIntyre.
Wehipeihana, N. (2019). Increasing cultural competence in support of Indigenous-led evaluation: A necessary step toward Indigenous-led evaluation. Canadian Journal of Program Evaluation, 34(2), 368–384.
Wilkinson, J., Goff, M., Rusoja, E., Hanson, C., & Swanson, R. C. (2018). The application of systems thinking concepts, methods, and tools to global health practices: An analysis of case studies. Journal of Evaluation in Clinical Practice, 24(3), 607–618.
Wolf, P. R., & Rickard, J. A. (2003). Talking circles: A Native American approach to experiential learning. Journal of Multicultural Counseling and Development, 31(1), 39–43.
Wolfgramm, T. H. (2023). Creating a Māori Indigenous model of evaluation, founded on Māori Indigenous values [University of Technology]. The AUT Research Repository. https://openrepository.aut.ac.nz/items/dfc9914c-a7e3-4df7-a90f-4624f8b334e1
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Tara Erb, Jimena Garcia, Krista Stelkia
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
