Increasing Cultural Competence in Support of Indigenous-Led Evaluation

A Necessary Step toward Indigenous-Led Evaluation

Authors

  • Nan Wehipeihana Research Evaluation Consultancy Limited

DOI:

https://doi.org/10.3138/cjpe.68444

Keywords:

control, culturally responsive evaluation, decision making, Indigenous evaluation, Indigenous-led, Kaupapa Māori, power

Abstract

This paper builds on a keynote paper presented at the 2018 Canadian Evaluation Society annual conference by Nan Wehipeihana, an Indigenous (Māori) evaluator from Aotearoa New Zealand. Nan defines Indigenous evaluation as evaluation that is led by Indigenous peoples; has clear benefits for Indigenous peoples; has Indigenous people comprising most of the evaluation team; is responsive to tribal and community contexts; and is guided and underpinned by Indigenous principles, practices, and knowledge. She argues for Indigenous led as a key criterion for Indigenous evaluation, with no assumed or automatic role for non-Indigenous peoples unless by invitation. She outlines a range of tactics to support the development of Indigenous evaluators and Indigenous evaluation and presents a model for non-Indigenous evaluators to assess their practice and explore how power is shared or not shared in evaluation with Indigenous peoples, as a necessary precursor to increasing control of evaluation by Indigenous peoples.

References

Bishop, R. (2005). Freeing ourselves from neocolonial domination in research: A Kaupapa Maori approach to creating knowledge. In N. Denzin & Y. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 109–138). Thousand Oaks, CA: SAGE.

Brayboy, B. M., & Deyhle, D. (2000). Insider-outsider: Researchers in American Indian communities. Theory into Practice, 39(3), 163–169. https://doi.org/10.1207/s15430421tip3903_7

Chilisa, B. (2012). Indigenous research methodologies. Los Angeles, CA: SAGE.

Cram, F. (1997). Developing partnerships in research: Pākehā researchers and Māori research. SITES, 35 , 44–63.

Cram, F. (2001). Rangahau Maori: Tona Tika, Tona Pono—The validity and integrity of Māori. In M. Tolich (Ed.), Research ethics in Aotearoa New Zealand (pp. 35–52). Auckland, New Zealand: Pearson Education.

Cram, F. (2009). Maintaining indigenous voices. In D. Mertens & P. Ginsberg (Eds.), The SAGE handbook of social science research ethics (pp. 308–322). Thousand Oaks, CA: SAGE.

Cram, F. (2016). Lessons on decolonizing evaluation from Kaupapa Māori evaluation. Canadian Journal of Program Evaluation, 30(3), 296–312. https://doi.org/10.3138/cjpe.30.3.04

Cram, F., Chilisa, B., & Mertens, D. M. (2013). The journey begins. In D. M. Mertens, F. Cram, & B. Chilisa (Eds.), Indigenous pathways into social research: Voices of a new generation (pp. 11–40). Walnut Creek, CA: Left Coast Press.

Durie, M. (1994). Whaiora: Māori health development. Auckland: Oxford University Press.

Durie, M. (1999, December). Te Pae Mahutonga: A model for Māori health promotion. Health Promotion Forum of New Zealand Newsletter, 49 , 2–5.

Durie, M. (2001). A framework for considering Māori educational advancement: Th e Hui Taumata Matauranga. Taupo, New Zealand: Massey University.

Goodwin, D., Sauni, P., & Were, L. (2015). Cultural fit: An important criterion for effective interventions and evaluation work. Evaluation Matters—He Take Tō Te Aromatawai, 1 , 25–46. https://doi.org/10.18296/em.0003

Greene, J. C. (2005). Evaluators as stewards of the public good. In S. Hood, H. Frierson, & R. Hopson (Eds.), The role of culture and cultural context in evaluation: A mandate for inclusion, the discovery of truth and understanding (pp. 7–20). Charlotte, NC: Information Age Publishing.

Greene, J. C. (2011). Evaluation and the public good: A mixed methods perspective. Paper presented at the Aotearoa New Zealand Evaluation Association Conference, Wellington, New Zealand.

Harvey, G. (2003). Guesthood as ethical decolonising research method. Numen: International Review for the History of Religions, 50(2), 125–146. https://doi.org/10.1163/156852703321506132

Health Research Council of New Zealand. (2010). Guidelines for research on health research involving Māori. Retrieved from http://www.hrc.govt.nz/news-and-publications/publications/guidelines-researchers-health-research-involving-m%C4%81ori

Henare, M. (1988). Ngā Tikanga Me Ngā Ritenga O Te Ao Māori. Standards and foundations of Māori society. In The April report: Report of the Royal Commission on Social Policy Future; Directions. Vol 3, part 1: Future directions, associated papers (pp. 3–42). Wellington, New Zealand: The Royal Commission on Social Policy.

Johnson, A. (2001). Privilege, power and difference. Mountain View, CA: Mayfield.

Kirkhart, K. E. (2010). Eyes on the prize: Multicultural validity and evaluation theory. American Journal of Evaluation, 31 (3), 400–413. https://doi.org/10.1177/1098214010373645

Kirkhart, K. E. (2015). Unpacking the evaluator’s toolbox: Observations on evaluation, privilege, equity and justice. Evaluation Matters—He Take Tō Te Aromatawai, 1 , 7–24. https://doi.org/10.18296/em.0002

LaFrance, J., & Nichols, R. (2010). Reframing evaluation: Defining an indigenous evaluation framework. Canadian Journal of Program Evaluation, 23 (2), 13–31.

Marsden, M., & Royal, T. A. C. (2003). The woven universe: Selected writings of Rev. Māori Marsden. N.p.: Estate of Rev. Māori Marsden. Mertens, D. M. (2009). Transformative research and evaluation. New York, NY: Guilford Press.

Ministry of Health. (2015). Māori health models. Retrieved from https://www.health.govt.nz/our-work/populations/maori-health/maori-health-models

Ministry for Social Development. (2004). Ngā Ara Tohutohu Rangahau Māori—Guidelines for Research and Evaluation with Māori. Centre for Social Research and Evaluation Te Pokapü Rangahau Arotake Hapori. Wellington, New Zealand: Minstry for Social Development.

Ormond, A., Cram, F., & Carter, L. (2006). Researching our relations: Reflections on ethics. Alternative: An International Journal of Indigenous Scholarship, Special supplement 2006—Marginalisation, 180–198.

Pere, R. (1982). Ako: Concepts and Learning in the Maori tradition. Hamilton, New Zealand: University of Waikato Press.

Sanakar, M. (2017). A stocktake on culturally responsive evaluation in and outside the UN system. A discussion document prepared for UNEG Strategic Objective 3: Evaluation informs UN system-wide initiatives and emerging demands. United Nations Evaluation Group, UNESCO Evaluation Office.

Smith, G. H. (1990). Research issues related to Mäori education. Paper presented at the NZARE Special Interests Conference.

Smith, G. H. (1997). The development of Kaupapa Māori: Theory and praxis (Unpublished doctoral thesis). University of Auckland, Auckland, New Zealand.

Smith, L. T. (1999). Decolonising methodologies: Research and Indigenous peoples. Dunedin, New Zealand: University of Otago Press.

Spiller, C., & Stockdale, M. (2013). Managing and leading from a Māori perspective: Bringing new life and energy to organisations. In J. Neal (Ed.), Handbook of faith and spirituality in the workplace: Emerging research and practice (pp. 149–173). New York, NY: Springer. https://doi.org/10.1007/978-1-4614-5233-1_11

Teariki, C., Spoonley, P., & Tomoana, N. (1992). Te Whakapakari te Mana Tangata: The Politics and Process of Research for Māori. Palmerston North, New Zealand: Massey University.

Te Awekotuku, N. (1991). He tikanga whakaaro: Research ethics in Māori community . A discussion paper. Wellington, New Zealand.

Te Puni Kōkiri. (1999). Evaluation for Māori: Guidelines for government agencies . Aroturuki me te Arotakenga Monitoring and Evaluation Branch. Wellington, New Zealand: Te Puni Kōkiri.

Te Puni Kōkiri and Treasury. (2019). An Indigenous approach to the living standards framework. The Treasury Discussion Paper 19/01. Wellington, New Zealand: Treasury.

Walker, H. (1990). Māori attitudes on research. Wellington, New Zealand: Department of Social Welfare

Wehipeihana, N. (2013). A vision for Indigenous evaluation. Keynote paper presented at the Australasian Evaluation Society Conference.

Wehipeihana, N., Bailey, R., Davidson, E. J., & McKegg, K. (2014). Evaluator competen¬cies: The Aotearoa New Zealand experience. Canadian Journal of Program Evaluation, 28 (3), 49–69.

Wehipeihana, N., Davidson, E. J., McKegg, K., & Shanker, V. (2010). What does it take to do evaluation in communities and cultural contexts other than our own? Journal of MultiDisciplinary Evaluation, 6 (13), 182–192.

Wehipeihana, N., & McKegg, K. (2018). Values and culture in evaluative thinking: Insights from Aotearoa New Zealand. New Directions for Evaluation, 158, 93–107. https://doi.org/10.1002/ev.20320

Wehipeihana, N., McKegg, K., Thompson, V., & Pipi, K. (2015). Cultural responsiveness through developmental evaluation: Indigenous innovations in sport and traditional Māori recreation. In M. Q. Patton, K. McKegg, & N. Wehipeihana (Eds.), Developmen¬tal evaluation exemplars: Principles in practice (pp. 25–44). New York, NY: Guilford Press.

Wilson, S. (2008). Research is ceremony: Indigenous research methods. Black Point, NS: Fernwood.

Downloads

Published

2019-04-21

How to Cite

Wehipeihana, N. (2019). Increasing Cultural Competence in Support of Indigenous-Led Evaluation: A Necessary Step toward Indigenous-Led Evaluation. Canadian Journal of Program Evaluation, 34(2), 368–384. https://doi.org/10.3138/cjpe.68444

Issue

Section

Theme Segment: CES Keynote Panel

Most read articles by the same author(s)