Indigenous Health Service Evaluation
Principles and Guidelines from a Provincial “Three Ribbon” Expert Panel
DOI:
https://doi.org/10.3138/cjpe.68831Keywords:
decolonization, guiding principles, Indigenous, Indigenous experience, self-determinationAbstract
A group of Indigenous health and social service evaluators called the “Three Ribbon” panel came together in Toronto in 2015/16 with the goal of informing a set of evidence-based guidelines for urban Indigenous health and social service and program evaluation. The collective knowledge and experiences of the Three Ribbon panel was gathered through discussion circles and synthesized around the following areas: barriers to conducting Indigenous health and social service evaluation; decolonizing principles and protocols that support community self-determination and centralize Indigenous culture and worldviews; and guidelines to inform health and social service evaluation moving forward. The wisdom and contributions of the Three Ribbon Panel creates space for Indigenous worldviews, values, and beliefs within program evaluation practice and has important implications for evaluation research and application.
References
Absolon, K. (2010). Indigenous wholistic theory: A knowledge set for practice. First Peoples Child and Family Review, 5(2): 74 – 87.
American Evaluation Association. (2007). American evaluation association: Guiding principles for evaluators. American Journal of Evaluation, 28(4), 397 – 398. https://doi.org/10.1177/10982140070280040701
Carjuzaa, J., & Fenimore-Smith, K. (2010). The give away spirit: Reaching a shared vision of ethical indigenous research relationships . Journal of Educational Controversy, 5(2). Retrieved from https://cedar.wwu.edu/jec/vol5/iss2/4/
Castleden, H., Garvin, T., & Huu-ay-aht First Nation. (2008). Modifying Photovoice for community-based participatory Indigenous research. Social Science and Medicine, 66(6), 1393 – 1405. https://doi.org/10.1016/j.socscimed.2007.11.030. Medline:18191883
Chouinard, J. A., & Cousins, J. B. (2007). Culturally competent evaluation for aboriginal communities: A review of the empirical literature. Journal of MultiDisciplinary Evaluation, 4(8), 40 – 57.
Cram, F. (2018). Conclusion: Lessons about indigenous evaluation. New Directions for Evaluation, 2018(159), 121 – 133. https://doi.org/10.1002/ev.20326
Crowshoe, R., & Manneschmidt, S. (2002). Akak’stiman: A blackfoot framework for decision-making and meditation process. Calgary, AB: University of Calgary Press.
Firestone, M., Smylie, J., Maracle, S., Siedule, C., De dwa da dehs nye>s Aboriginal Health Access Centre, Métis Nation of Ontario, & O’Campo, P. (2014). Concept mapping: Application of a community-based methodology in three urban Aboriginal populations. American Indian Culture and Research Journal, 38(4), 85 – 104. https://doi.org/10.17953/aicr.38.4.571154up25876h72
Geia, L. K., Hayes, B., & Usher, K. (2013). Yarning/Aboriginal storytelling: Towards an understanding of an Indigenous perspective and its implications for research practice. Contemporary Nurse, 46(1), 13 – 17. https://doi.org/10.5172/conu.2013.46.1.13. Medline:24716757
Grover, J. G. (2008). Challenges in applying indigenous evaluation practices in mainstream grant programs to indigenous communities . Canadian Journal of Program Evaluation, 23( 2 ), 33 – 50. Retrieved from http://ovidsp.ovid.com/ovidweb.cgi?T=JSandCSC=YandNEWS=NandPAGE=fulltextandD=psyc5andAN=2010-10284-002
Hill, G., & Wilkinson, A. (2014). Indigegogy: A transformative indigenous educational process. Canadian Social Work Review/Revue Canadienne de Service Social, 31(2), 175 – 193.
Johnston-Goodstar, K. (2012). Decolonizing evaluation: The necessity of evaluation advisory groups in indigenous evaluation. New Directions for Evaluation, 136, 109 – 117. https://doi.org/10.1002/ev.20038
Kirkness, V. J., & Barnhardt, R. (1991). First nations and higher education: The four R’s – respect, relevance, reciprocity, responsibility. Journal of American Indian Education, 30(3), 1 – 15.
Lafrance, J. , Nichols , R. , & Kirkhart , K. E. ( 2012 ). Culture writes the script: On the centrality of context in indigenous evaluation. New Directions for Evaluation, 135, 59 – 74 . https://doi.org/10.1002/ev.20027
Lavoie , J. G., Forget, E., & O’Neil, J. D. (2007). Why equity in financing first nations on-reserve health services matters: Findings from the 2005 national evaluation of the health transfer policy. Healthcare Policy = Politiques de Sante, 2(4), 79 – 96. Medline:19305735
Maddox, R., Blais, G., Monchalin, R., Zeigler, C., Firestone, M., Mashford-Pringle, Monchalin, R. (n.d.). Systematic review of Indigenous health service and program evaluation. Article submitted for peer review.
National Aboriginal Health Organization. (2006). First nations conceptual frameworks and applied models on ethics, privacy, and consent in health research and information. Ottawa, ON : Author.
Scott, S. (2008). Drawing on indigenous ways of knowing: Reflections from a community evaluator. Canadian Journal of Program Evaluation, 23(2), 73 – 92.
Smylie, J., Anderson, I., Ratima, M., Crengle, S., & Anderson, M. (2006). Indigenous health performance measurement systems in Canada, Australia, and New Zealand. Lancet, 367(9527), 2029 – 2031. https://doi.org/10.1016/S0140-6736(06)68893-4. Medline:16782494
Smylie, J. , & Firestone, M. (2015). Back to the basics: Identifying and addressing underlying challenges in achieving high quality and relevant health statistics for indigenous populations in Canada. Statistical Journal of the International Association for Official Statistics (IAOS), 31(1), 67 – 87. https://doi.org/10.3233/SJI-150864. Medline:26793283
Truth and Reconciliation Commission of Canada. 2015. Truth and Reconciliation Commission of Canada: Calls to Action. Retrieved from http://trc.ca/assets/pdf/Calls_to_ Action_English2.pdf
Waapalaneexkweew (N. Bowman, Mohican/Lunaape), & Dodge-Francis, C . (2018). Culturally responsive indigenous evaluation and tribal governments: Understanding the relationship. New Directions for Evaluation, 2018(159), 17 – 31. https://doi.org/10.1002/ev.20329
Weber-Pillwax, C. (2004). Indigenous researchers and Indigenous research methods: Cultural influences or cultural determinants of research methods. Pimatsiwin: A Journal of Aboriginal and Indigenous Community Health, 2(1), 77 – 90.
Well Living House. (2017a). Well living house. Retrieved from https://www.welllivinghouse.com
Well Living House. (2017b). Emergent principles and protocols for indigenous health service evaluation: Summary report of a provincial “three ribbons” expert consensus panel. Retrieved from http://www.welllivinghouse.com/wp-content/uploads/2017/03/1-Summary_Document_3RibbonPanel_Formatted_March2017_FINAL_2-28229-PRINTINGVERS.pdf
Wilson, S. (2008). Research is ceremony: Indigenous research methods. Halifax, NS: Fernwood Publishing.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Michelle Firestone, Raglan Maddox, Patricia O’Campo, Janet Smylie, Cheryllee Bourgeois, Sara Wolfe, Susan Snelling, Heather Manson, Constance McKnight, Jeanne Hebert, Roger Boyer II, Wayne Warry, Vicki van Wagner

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.





