Indigenous Health Service Evaluation

Principles and Guidelines from a Provincial “Three Ribbon” Expert Panel

Authors

  • Michelle Firestone St. Michael’s Hospital
  • Raglan Maddox St. Michael’s Hospital
  • Patricia O’Campo St. Michael’s Hospital
  • Janet Smylie St. Michael’s Hospital
  • Cheryllee Bourgeois Seventh Generation Midwives Toronto
  • Sara Wolfe Seventh Generation Midwives Toronto
  • Susan Snelling Public Health Ontario
  • Heather Manson Public Health Ontario
  • Constance McKnight De dwa da dehs ney>s Aboriginal Health Access Centre
  • Jeanne Hebert De dwa da dehs ney>s Aboriginal Health Access Centre
  • Roger Boyer II Maamwesying North Shore Community Health Services
  • Wayne Warry University of Minnesota
  • Vicki van Wagner Ryerson University

DOI:

https://doi.org/10.3138/cjpe.68831

Keywords:

decolonization, guiding principles, Indigenous, Indigenous experience, self-determination

Abstract

A group of Indigenous health and social service evaluators called the “Three Ribbon” panel came together in Toronto in 2015/16 with the goal of informing a set of evidence-based guidelines for urban Indigenous health and social service and program evaluation. The collective knowledge and experiences of the Three Ribbon panel was gathered through discussion circles and synthesized around the following areas: barriers to conducting Indigenous health and social service evaluation; decolonizing principles and protocols that support community self-determination and centralize Indigenous culture and worldviews; and guidelines to inform health and social service evaluation moving forward. The wisdom and contributions of the Three Ribbon Panel creates space for Indigenous worldviews, values, and beliefs within program evaluation practice and has important implications for evaluation research and application.

References

Absolon, K. (2010). Indigenous wholistic theory: A knowledge set for practice. First Peoples Child and Family Review, 5(2): 74 – 87.

American Evaluation Association. (2007). American evaluation association: Guiding principles for evaluators. American Journal of Evaluation, 28(4), 397 – 398. https://doi.org/10.1177/10982140070280040701

Carjuzaa, J., & Fenimore-Smith, K. (2010). The give away spirit: Reaching a shared vision of ethical indigenous research relationships . Journal of Educational Controversy, 5(2). Retrieved from https://cedar.wwu.edu/jec/vol5/iss2/4/

Castleden, H., Garvin, T., & Huu-ay-aht First Nation. (2008). Modifying Photovoice for community-based participatory Indigenous research. Social Science and Medicine, 66(6), 1393 – 1405. https://doi.org/10.1016/j.socscimed.2007.11.030. Medline:18191883

Chouinard, J. A., & Cousins, J. B. (2007). Culturally competent evaluation for aboriginal communities: A review of the empirical literature. Journal of MultiDisciplinary Evaluation, 4(8), 40 – 57.

Cram, F. (2018). Conclusion: Lessons about indigenous evaluation. New Directions for Evaluation, 2018(159), 121 – 133. https://doi.org/10.1002/ev.20326

Crowshoe, R., & Manneschmidt, S. (2002). Akak’stiman: A blackfoot framework for decision-making and meditation process. Calgary, AB: University of Calgary Press.

Firestone, M., Smylie, J., Maracle, S., Siedule, C., De dwa da dehs nye>s Aboriginal Health Access Centre, Métis Nation of Ontario, & O’Campo, P. (2014). Concept mapping: Application of a community-based methodology in three urban Aboriginal populations. American Indian Culture and Research Journal, 38(4), 85 – 104. https://doi.org/10.17953/aicr.38.4.571154up25876h72

Geia, L. K., Hayes, B., & Usher, K. (2013). Yarning/Aboriginal storytelling: Towards an understanding of an Indigenous perspective and its implications for research practice. Contemporary Nurse, 46(1), 13 – 17. https://doi.org/10.5172/conu.2013.46.1.13. Medline:24716757

Grover, J. G. (2008). Challenges in applying indigenous evaluation practices in mainstream grant programs to indigenous communities . Canadian Journal of Program Evaluation, 23( 2 ), 33 – 50. Retrieved from http://ovidsp.ovid.com/ovidweb.cgi?T=JSandCSC=YandNEWS=NandPAGE=fulltextandD=psyc5andAN=2010-10284-002

Hill, G., & Wilkinson, A. (2014). Indigegogy: A transformative indigenous educational process. Canadian Social Work Review/Revue Canadienne de Service Social, 31(2), 175 – 193.

Johnston-Goodstar, K. (2012). Decolonizing evaluation: The necessity of evaluation advisory groups in indigenous evaluation. New Directions for Evaluation, 136, 109 – 117. https://doi.org/10.1002/ev.20038

Kirkness, V. J., & Barnhardt, R. (1991). First nations and higher education: The four R’s – respect, relevance, reciprocity, responsibility. Journal of American Indian Education, 30(3), 1 – 15.

Lafrance, J. , Nichols , R. , & Kirkhart , K. E. ( 2012 ). Culture writes the script: On the centrality of context in indigenous evaluation. New Directions for Evaluation, 135, 59 – 74 . https://doi.org/10.1002/ev.20027

Lavoie , J. G., Forget, E., & O’Neil, J. D. (2007). Why equity in financing first nations on-reserve health services matters: Findings from the 2005 national evaluation of the health transfer policy. Healthcare Policy = Politiques de Sante, 2(4), 79 – 96. Medline:19305735

Maddox, R., Blais, G., Monchalin, R., Zeigler, C., Firestone, M., Mashford-Pringle, Monchalin, R. (n.d.). Systematic review of Indigenous health service and program evaluation. Article submitted for peer review.

National Aboriginal Health Organization. (2006). First nations conceptual frameworks and applied models on ethics, privacy, and consent in health research and information. Ottawa, ON : Author.

Scott, S. (2008). Drawing on indigenous ways of knowing: Reflections from a community evaluator. Canadian Journal of Program Evaluation, 23(2), 73 – 92.

Smylie, J., Anderson, I., Ratima, M., Crengle, S., & Anderson, M. (2006). Indigenous health performance measurement systems in Canada, Australia, and New Zealand. Lancet, 367(9527), 2029 – 2031. https://doi.org/10.1016/S0140-6736(06)68893-4. Medline:16782494

Smylie, J. , & Firestone, M. (2015). Back to the basics: Identifying and addressing underlying challenges in achieving high quality and relevant health statistics for indigenous populations in Canada. Statistical Journal of the International Association for Official Statistics (IAOS), 31(1), 67 – 87. https://doi.org/10.3233/SJI-150864. Medline:26793283

Truth and Reconciliation Commission of Canada. 2015. Truth and Reconciliation Commission of Canada: Calls to Action. Retrieved from http://trc.ca/assets/pdf/Calls_to_ Action_English2.pdf

Waapalaneexkweew (N. Bowman, Mohican/Lunaape), & Dodge-Francis, C . (2018). Culturally responsive indigenous evaluation and tribal governments: Understanding the relationship. New Directions for Evaluation, 2018(159), 17 – 31. https://doi.org/10.1002/ev.20329

Weber-Pillwax, C. (2004). Indigenous researchers and Indigenous research methods: Cultural influences or cultural determinants of research methods. Pimatsiwin: A Journal of Aboriginal and Indigenous Community Health, 2(1), 77 – 90.

Well Living House. (2017a). Well living house. Retrieved from https://www.welllivinghouse.com

Well Living House. (2017b). Emergent principles and protocols for indigenous health service evaluation: Summary report of a provincial “three ribbons” expert consensus panel. Retrieved from http://www.welllivinghouse.com/wp-content/uploads/2017/03/1-Summary_Document_3RibbonPanel_Formatted_March2017_FINAL_2-28229-PRINTINGVERS.pdf

Wilson, S. (2008). Research is ceremony: Indigenous research methods. Halifax, NS: Fernwood Publishing.

Downloads

Published

2020-01-21

How to Cite

Firestone, M., Maddox, R., O’Campo, P., Smylie, J., Bourgeois, C., Wolfe, S., … van Wagner, V. (2020). Indigenous Health Service Evaluation: Principles and Guidelines from a Provincial “Three Ribbon” Expert Panel. Canadian Journal of Program Evaluation, 34(3), 413–424. https://doi.org/10.3138/cjpe.68831

Issue

Section

Framing the Discussion

Most read articles by the same author(s)