Establishing and Developing Professional Evaluator Dispositions
DOI:
https://doi.org/10.3138/cjpe.71156Keywords:
evaluator training, evaluator competencies, professional dispositionsAbstract
A basic principle associated with competent evaluation practice asserts that evaluators should possess the education, abilities, skills, and experience needed to undertake the tasks proposed in an evaluation. For those training evaluators this also means teaching professional dispositions, because an individual’s dispositions (i.e., beliefs and values) influence how they will act as professionals. Personal dispositions held by individual evaluators at times conflict with the values and beliefs of their professional organization. Competent evaluators must be able to manage personal dispositions in ways that allow professional values and positions to guide their practice. In order for evaluation educators to teach evaluator competencies, we must understand the underlying dispositions associated with each competency. We must also identify which dispositions are essential for professional practice. This article discusses the issue of dispositions and the challenges of helping evaluators develop positive professional dispositions.
References
Ajzen, I. (1991). Th e theory of planned behaviour. Organizational behaviour and human decision processes, 50(2), 179 – 211. https://doi.org/10.1016/0749-5978(91)90020-t
Alkin, M. C. (2012). Evaluation roots: A wider perspective of theorists’ views and influences. Sage.
Alsup, J., & Miller, S. J. (2014). Reclaiming English education: Rooting social justice in dispositions. English Education, 46(3), 195 – 215.
American Evaluation Association. (2011). American Evaluation Association public statement on cultural competence in evaluation. https://www.eval.org/p/cm/ld/fi d=92
American Evaluation Association. (2013). American Evaluation Association response to U.S. Department of Education. http://www.eval.org/p/cm/ld/fid=95
American Evaluation Association. (2018). American evaluation association guiding principles for evaluators. https://www.eval.org/p/cm/ld/fid=51
American Evaluation Association Evaluator Competencies Task Force. (2017). Presenting the final draft of the AEA Evaluator Competencies. AEA conference presentation, Washington, DC.
American Evaluation Association Evaluator Competencies Task Force. (2018). The 2018 AEA evaluator competencies. https://www.eval.org/page/competencies
American Institute of Certified Public Accountants. (2014). AICPA code of professional conduct. https://pub.aicpa.org/codeofconduct/Ethics.aspx#
Anderson, L. W., & Bourke, S. F. (2000). Assessing affective characteristics in the schools (2nd ed). Lawrence Erlbaum Associates.
Aotearoa New Zealand Evaluation Association. (2011). Evaluator competencies. https://www.anzea.org.nz/app/uploads/2019/04/ANZEA-Superu-Evaluation-standards-final-020415.pdf
Aultman, J., & Whipkey, A. J. (2019). Moving beyond moral revulsion: A deeper analysis of social justice within clinical ethics training. The American Journal of Bioethics, 19(4), 67 – 69. https://doi.org/10.1080/15265161.2019.1572821
Australasian Evaluation Society (AES). (2013). Evaluators’ professional learning competency framework. Australasian Evaluation Society, Melbourne, Australia.
Bazerman, M. H., & Tenbrunsel, A. E. (2011). Ethical breakdowns. Harvard Business Review, 89(4), 58 – 65.
Bloom, B. S. (1969). Taxonomy of educational objectives: The classification of educational goals. Handbook I. Cognitive Domain. McKay.
Canadian Evaluation Society. (2018). Competencies for Canadian evaluation practice. https://evaluationcanada.ca/competencies-canadian-evaluators
Chartered Institute of Management Accountants. (2015). CIMA code of ethics. https://www.cimaglobal.com/Professionalism/Ethics/CIMA-code-of-ethics-for-professional-accountants/
Council on Social Work. (2018). Council on Social Work education core competency. https://www.cswe.org/getattachment/Accreditation/Accreditation-Process/2015-EPAS/2015EPAS_Web_FINAL.pdf.aspx
Culiberg, B., & Mihelič, K. K. (2016). Three ethical frames of reference: Insights into Millennials’ ethical judgements and intentions in the workplace. Business Ethics: A European Review, 25(1), 94 – 111. https://doi.org/10.1111/beer.12106
Datta, L.-E. (2002). The case of the uncertain bridge. American Journal of Evaluation, 23, 187 – 206. https://doi.org/10.1177/109821400202300207
Davidson, E. J. (2004). Evaluation methodology basics: The nuts and bolts of sound evaluation. Sage.
Davies, R. S . (2009). Exploring the meaning and function of learner intent for students taking online university courses. VDM Publishing House.
Deal, T. E. , & Peterson , K. D. (2009). Shaping school culture: Pitfalls, paradoxes, and promises (2nd ed.). Jossey-Bass.
Donaldson, S. I., Christie, C. A., & Mark, M. M. (2014). Credible and actionable evidence: The foundation for rigorous and influential evaluations. Sage.
Dutson, A. J., Todd, R. H., Magleby, S. P., & Sorensen, C. D. (1997) A review of literature on teaching design through project-oriented capstone courses. Journal of Engineering Education, 76(1), 17 – 28. https://doi.org/10.1002/j.2168-9830.1997.tb00260.x
European Evaluation Society. (2015). The EES evaluation capabilities Framework. https://europeanevaluation.org/wp-content/uploads/2020/03/EES-EVALUATION-CAPABILITIES-FRAMEWORK.pdf
Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behaviour: An introduction to theory and research. Addison-Wesley.
Gephart, W. J., & Ingle, R. B. (1977). The introductory evaluation course. NSPER: 77. https://eric.ed.gov/?id=ED182347
Henle, C. A., Giacalone, R. A., & Jurkiewicz, C. L. (2005). The role of ethical ideology in workplace deviance . Journal of Business Ethics, 56(3), 219 – 230. https://doi.org/10.1007/s10551-004-2779-8
Huff, S. B. (2012 ). Culture rules: This is the way we do it here. McKay School of Education College Honored Alumni Lecture, Brigham Young University.
Johnson, S. M. (2018). The development and use of interpersonal competencies by evaluators (Unpublished doctoral dissertation). University of Minnesota.
King, J. A., & Stevahn, L. (2013). Interactive evaluation practice: Mastering the interpersonal dynamics of program evaluation. Sage.
Kirkhart, K. E. (2010). Eyes on the prize: Multicultural validity and evaluation theory. American Journal of Evaluation, 31(3), 400 – 413. https://doi.org/10.1177/1098214010373645
Krathwohl, D. R., Bloom, B. S., & Masia, B. B. (1964). Taxonomy of educational objectives: Handbook II: Affective domain. David McKay Co.
LaVelle, J. M., & Donaldson, S. I. (2015). Th e state of preparing evaluators. In J. W. Altschuld & M. Engle (Eds.), Accreditation, certification, and credentialing: Relevant concerns for U.S. evaluators. New Directions for Evaluation, 145, 39 – 52. https://doi.org/10.1002/ev.20110
LaVelle, J. M., Lovato, C. Y., & Stephenson C. L. (2020). Pedagogical considerations for the teaching of evaluation. Evaluation and Program Planning, 79. Article 101786. https://doi.org/10.1016/j.evalprogplan.2020.101786
Luegenbiehl, H., & Clancy, R. (2017). Global engineering ethics. Butterworth-Heinemann.
McElroy, W. (2005). Cultural competence: Coming to a school near you? https://www.lewrockwell.com/2005/10/wendy-mcelroy/cultural-competence-coming-to-a-school-nearyou/
Morris, M. (2009). The fifth guiding principle: Beacon, banality, or Pandora’s box? American Journal of Evaluation, 30(2), 220 – 224. https://doi.org/10.1177/1098214009334589
Morris, M. (2011). The good, the bad, and the evaluator: 25 years of AJE ethics. American Journal of Evaluation, 32(1), 134 – 151. https://doi.org/10.1177/1098214010388267
National Council for Accreditation of Teacher Education. (2002). Professional standards for the accreditation of schools, colleges, and departments of education. Author.
National Council for the Accreditation of Teacher Education. (2008). Professional Standards Accreditation of Teacher Preparation Institutions http://www.ncate.org/~/media/Files/caep/accreditation-resources/ncate-standards-2008.pdf?la=en
National League for Nursing. (2008). Nurse educator core competency. http://www.nln.org/professional-development-programs/competencies-for-nursing-education/nurse-educator-core-competency
Patton, M. Q. (1985). Cross-cultural nongeneralizations. In M. Q. Patton (Ed.), Culture and evaluation: New directions for program evaluation (vol. 25). Jossey-Bass.
Patton, M. Q. (1990). Qualitative evaluation and research methods. Sage.
Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Sage.
Powers, E. (2006). A spirited disposition debate. Inside Higher Education. http://www.insidehighered.com/news/2006/06/06/disposition
Ravitch, D. (2004). The language police: How pressure groups restrict what students learn. Random House.
Roberts, R. (2006). Assessing teacher dispositions. Presentation at the annual meeting of the American Association of Colleges of Teacher Education, San Diego, CA.
Sasaki , J. Y., & Kim, H. S. (2017). Nature, nurture, and their interplay: A review of cultural neuroscience. Journal of Cross-Cultural Psychology, 48(1), 4 – 22. https://doi.org/10.1177/0022022116680481
Schwandt, T. A. (2002). Evaluation practice reconsidered. Peter Lang.
Shuman, L. J., Besterfield -Sacre, M., & McGourty, J. (2005). The ABET “professional skills”: Can they be taught? Can they be assessed? Journal of Engineering Education, 94(1), 41 – 55. https://doi.org/10.1002/j.2168-9830.2005.tb00828.x
Shussler, D., Stookberry, L., & Bercaw, L. (2005). Conceptualizing dispositions: Intellectual, cultural, and moral domains of teaching. Paper presented at the annual meeting of the American Educational Research Association, Montreal, QC.
Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications (2nd ed.). Jossey-Bass & Pfeiffer Imprints, Wiley.
UK Evaluation Society. (2013). Framework of evaluation capabilities. https://www.evaluation.org.uk/app/uploads/2019/04/UK-Evaluation-Society-Framework-of-Evaluation-Capabilities.pdf
United Nations Evaluation Group. (2008). Core competencies for evaluators of the UN system. http://www.uneval.org/document/detail/1408
Wehipeihana, N., Bailey, R., Davidson, E. J., & McKegg, K. (2014). Evaluator competencies: The Aotearoa New Zealand experience. The Canadian Journal of Program Evaluation, 28(3), 49 – 69.
Will, G. (2006 , January 16). Ed schools vs. education. Newsweek.
World Health Organization. (2013). WHO evaluation practice handbook. https://apps.who.int/iris/bitstream/10665/96311/1/9789241548687_eng.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Randall Davies
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
