The Role of Evaluative Thinking in the Teaching of Evaluation
DOI:
https://doi.org/10.3138/cjpe.69753Keywords:
evaluation capacity building, evaluative thinking, practical wisdom, reflective practice, teaching of evaluationAbstract
In this practice note, I share some reflections on the role of evaluative thinking in the teaching of evaluation. I teach an introductory graduate-level evaluation course to Master’s and doctoral students, and I provide Evaluation Capacity Building (ECB) workshops to various community-based education organizations, non-governmental organizations, non-profits, foundations, and groups of emerging evaluators. In this practice note I use a reflective case study augmented with analysis against salient theoretical frameworks to reflect on evaluative thinking as a way to balance teaching theory and practice; infuse adult education principles and practices, which can also help learners hone in on the potential for evaluation for social justice; and equip students for continuing professional development—helping them become lifelong learners in evaluation.
References
Archibald , T. ( 2019 ). Whose extension counts? A plurality of extensions and their implications for credible evidence debates . Journal of Human Sciences and Extension, 7(2),22 – 35.
Archibald, T., Neubauer, L. C., & Brookfield, S. D. (2018). The critically reflective evaluator: Adult education’s contributions to evaluation for social justice. In A. T. Vo & T. Archibald (Eds.), Evaluative thinking: New directions for evaluation (vol. 158 , pp. 109 – 123).
Argyris, C. (2004). Reasons and rationalizations: The limits to organizational knowledge. Oxford University Press.
Astbury , B. (2016). Reframing how evaluators think and act: New insights from Ernest House. Evaluation, 22(1), 58 – 71. https://doi.org/10.1177/1356389015623125
Biesta, G. J. J. (2010). Why “what works” still won’t work: From evidence-based education to value-based education. Studies in Philosophy and Education, 29(5), 491 – 503. https://doi.org/10.1007/s11217-010-9191-x
Brookfield, S. D. (2012). Teaching for critical thinking: Tools and techniques to help students question their assumptions. Jossey-Bass.
Brookfield, S. D., & Holst, J. D. (2011). Radicalizing learning: Adult education for a just world. Jossey-Bass.
Buchanan, H., & Kuji-Shikatani, K. (2014). Evaluator competencies: The Canadian experience. Canadian Journal of Program Evaluation, 28(3), 29 – 47.
Buckley, J., Archibald, T., Hargraves, M. , & Trochim , W. M. (2015). Defining and teaching evaluative thinking: Insights from research on critical thinking. American Journal of Evaluation, 36(3), 375 – 388. https://doi.org/10.1177/1098214015581706
Campbell, D. T. (1974). Evolutionary epistemology. In P. A. Schilpp (Ed.), The philosophy of Karl R. Popper (pp. 412 – 463). Open Court.
Chaplowe, S. G., & Cousins, J. B. (2016). Monitoring and evaluation training: A systematic approach. Sage.
Dewey, J. D., Montrosse, B. E., Schröter, D. C., Sullins, C. D., & Mattox, J. R. (2008). Evaluator competencies: What’s taught versus what’s sought. American Journal of Evaluation, 29(3), 268 – 287. https://doi.org/10.1177/109821400832115
Donaldson, S. I., Christie, C. A., & Mark, M. M. (Eds.). (2014). Credible and actionable evidence: Th e foundation for rigorous and influential evaluations. Sage.
Freire, P. (1970). Pedagogy of the oppressed (M. B. Ramos , Trans.). Continuum.
Galport, N., & Azzam, T. (2017). Evaluator training needs and competencies: A gap analysis. American Journal of Evaluation , 38(1), 80 – 100. https://doi.org/10.1177/1098214016643183
Ghere, G., King, J. A., Stevahn, L., & Minnema, J. (2006). A professional development unit for reflecting on program evaluator competencies. American Journal of Evaluation, 27(1), 108 – 123. https://doi.org/10.1177/1098214005284974
Greene, J., Millet, R., & Hopson, R. (2004). Evaluation as democratizing practice. In M. Braverman , N. Constantine , & J. K. Slater (Eds.), Putting evaluation to work for foundations and grantees (pp. 96 – 118). Jossey-Bass.
Gullickson, A. M., King, J. A., LaVelle, J. M., & Clinton, J. M. (2019). The current state of evaluator education: A situation analysis and call to action. Evaluation and Program Planning , 75 , 20 – 30 . https://doi.org/10.1016/j.evalprogplan.2019.02.012
Houle, S., Hurteau , M., & Bourgeois, I. (2018). L’évaluation de programme axée sur la rencontre des acteurs : une sagesse pratique. Presses de l’Université du Québec.
House, E. R. (2015). Evaluating: Values, biases, and practical wisdom. Information Age Publishing.
Kahneman, D. (2011). Th inking, fast and slow. Farrar, Straus and Giroux.
LaVelle, J. M. (2019). Educating evaluators 1976–2017: An expanded analysis of university-based evaluation education programs . American Journal of Evaluation, 41(4), 494 – 509. https://doi.org/10.1177/1098214019860914
LaVelle, J. M., & Donaldson, S. I . (2015). The state of preparing evaluators . New Directions for Evaluation, 145, 39 – 52.
Law , J. (2004). After method: Mess in social science research. Routledge.
Lederach, J. P., Neufeldt, R., & Culbertson, H. (2007). Reflective peacebuilding: A planning, monitoring and learning tool kit. Joan B. Kroc Institute, University of Notre Dame/CRS .
McDavid, J. C., Huse , I., & Hawthorn, L. R. (2019). Program evaluation and performance measurement: An introduction to practice (3rd ed.). Sage.
McFadden, A., & Williams, K. E. (2020). Teachers as evaluators: Results from a systematic literature review. Studies in Educational Evaluation, 64. Article 100830. https://doi.org/10.1016/j.stueduc.2019.100830
Mertens, D. M., & Wilson, A. T. (2018). Program evaluation theory and practice (2nd ed.). Guilford .
Oliver, D. E., Casiraghi, A. M., Henderson, J. L., Brooks, A. M., & Mulsow, M. (2008). Teaching program evaluation: Three selected pillars of pedagogy. American Journal of Evaluation, 29(3), 330 – 339. https://doi.org/10.1177/1098214008319876
Podems, D. R. (2018). Being an evaluator: Your practical guide to evaluation. Guilford .
Preskill, H., & Boyle, S. (2008). A multidisciplinary model of evaluation capacity building .American Journal of Evaluation, 29(4), 443 – 459. https://doi.org/10.1177/1098214008324182
Schwandt, T. A. (2015). Evaluation foundations revisited: Cultivating a life of the mind for practice. Stanford University Press.
Schwandt, T. A. (2018). Evaluative thinking as a collaborative social practice: The case of boundary judgment making. New Directions for Evaluation, 2018(158), 125 – 137. https://doi.org/10.1002/ev.20318
Scriven, M. (2013). The past, present and future of evaluation. Keynote presented at the Australasian Evaluation Society Conference, Melbourne.
Stevahn, L., King, J. A., Ghere, G., & Minnema, J. (2005). Establishing essential competencies for program evaluators. American Journal of Evaluation, 26(1), 43 – 59. https://doi.org/10.1177/1098214004273180
Sullivan, W. M., & Rosin, M. S. (2008). A new agenda for higher education: Shaping a life of the mind for practice. Jossey-Bass.
Vo, A. T., Schreiber, J. S., & Martin, A. (2018). Toward a conceptual understanding of evaluative thinking. New Directions for Evaluation, 2018(158), 29 – 47. https://doi.org/10.1002/ev.20324
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Thomas Archibald
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
