Redesigning a University-Based Evaluator Education Program for Scholarship and Practice

Authors

  • John LaVelle University of Minnesota, Minnesota
  • David Johnson University of Minnesota, Minnesota

DOI:

https://doi.org/10.3138/cjpe.71430

Keywords:

evaluator education, evaluation practice, evaluation scholarship, evaluator training, research on evaluation

Abstract

This paper describes the process that the faculty at the University of Minnesota used to redesign its graduate programs in evaluation. We build from the premise that evaluator education programs undergo periodic review to remain consistent with program goals and maintain alignment with competency taxonomies. With the retirement of a senior faculty member and the addition of a new junior faculty member, we decided the time had come to examine closely the existing MA and PhD curriculum. We describe our process for conceptualizing the program’s ultimate goals, examining course content, cross-referencing the courses with the AEA Competencies, and aligning all courses and processes with our revised programmatic goals. The result is a redesigned and streamlined curriculum to support evaluation practice for master’s students and both scholarship and practice for doctoral students.

References

Academic Standards Committee of the Academy of Human Resource Development (AHRD). (2008). Standards for HRD graduate program excellence. https://www.ahrd.org/page/standards_graduate

Alkin, M. C. (Ed.). (2012). Evaluation roots (2nd ed.). Sage.

Altschuld, J. W., Engle, M., Cullen, C. , Kim, I., & Macce, B. R. (1994). The 1994 directory of evaluation training programs. In J. W. Altschuld & M. Engle (Eds.), The preparation of professional evaluators: Issues, perspectives and programs (vol. 62 , pp. 71 – 94). New Directions for Program Evaluation. Jossey-Bass.

American Evaluation Association. (2018). AEA evaluator competencies. https://www.eval.org/About/Competencies-Standards/AEA-Evaluator-Competencies

Barr, H. (1998). Competent to collaborate: Towards a competency-based model for inter-professional education. Journal of Interprofessional Care, 12(2), 181 – 187. https://doi.org/10.3109/13561829809014104

Bartunek, J. M. (1983). How organizational development can develop organizational theory. Group and Organization Management, 8(3), 303 – 318. https://doi.org/10.1177/105960118300800308

Bright, D. F., & Richards, M. P. (2001). The academic deanship: Individual careers and institutional roles. Jossey-Bass.

Campbell, B., & Mark, M. M. (2015). How analogue research can advance descriptive evaluation theory: Understanding (and improving) stakeholder dialogue. American Journal of Evaluation, 36(2), 204-220. https://doi.org/10.1177/1098214014532166

Christie, C. A. (2003). What guides evaluation? A study of how evaluation practice maps onto evaluation theory. New Directions for Evaluation, 2003(97), 7 – 36. https://doi.org/10.1002/ev.72

Christie, C. A. (2006). The practice-theory relationship in evaluation. New Directions for Program Evaluation, 97. Jossey-Bass.

Christie, C. A. (2012). Advancing empirical scholarship to further develop evaluation theory and practice. Canadian Journal of Program Evaluation, 26(1), 1-18.

Comer, R. F., Clay, T., & Hill, P. (1980). Directory of evaluation training. Pintail Press .

Creswell, J. (2015). Educational research planning, conducting, and evaluating quantitative and qualitative research. Pearson.

Dillman, L. M. (2013). Evaluator skill acquisition: Linking educational experiences to competencies. American Journal of Evaluation, 34(2), 270 – 285. https://doi.org/10.1177/1098214012464512

Donaldson, S. I. , & Lipsey, M. (2006). Roles for theory in contemporary evaluation practice: Developing practical knowledge. In I. F. Shaw, J. C. Greene, & M. M. Mark (Eds.), The Sage handbook of evaluation (pp. 56 – 75). Sage.

Engle, M., Altschuld, J. W., & Kim, Y.-C. (2006). 2002 survey of evaluation preparation programs in universities: An update of the 1992 American Evaluation Association sponsored study . American Journal of Evaluation, 27(3), 353 – 359. https://doi.org/10.1177/1098214006288787

Etzioni, A. (1969). The semi-professions and their organization: Teachers, nurses, and social workers. Free Press.

Fitzpatrick, J., Christie, C., & Mark, M. (Eds.). (2008). Evaluation in action: Interviews with expert evaluators. Sage.

Fitzpatrick, M. R., Kovalak, A. L., & Weaver, A. (2010). How trainees develop an initial theory of practice: A process model of tentative

identifications. Counsellling and Psychotherapy Research, 10(2), 93 – 102. https://doi.org/10.1080/14733141003773790

Frank, J. R., Snell, L. S., Cate, O. T., Holmboe, E. S., Carraccio, C., Swing, S. R., . . . Harris, K. A. (2010). Competency-based medical education: Theory to practice. Medical Teacher, 32(8), 638 – 645. https://doi.org/10.3109/0142159x.2010.501190. Medline:20662574

Funnel, S. C., & Rogers, P. J. (2011). Purposeful program theory: Effective use of theories of change and logic models. John Wiley & Sons.

Glassick, C. E., Huber, M. T., & Maeroff, G. I. (1997). Scholarship assessed: Evaluation of the professoriate. Jossey-Bass.

Gregory, S. T. (2001). Black faculty women in the academy: History, status, and future. Journal of Negro Education, 70(3), 124 – 138 . https://doi.org/10.2307/3211205

Gullickson, A. M., King, J. A., LaVelle, J. M., & Clinton, J. M. (2019). The current state of evaluator education: A situation analysis and call to action. Evaluation and Program Planning, 75, 20 – 30. https://doi.org/10.1016/j.evalprogplan.2019.02.012. Medline:31015094

Harris, P., Snell, L., Talbot, M., & Harden, R. M. (2010). Competency-based medical education: Implications for undergraduate programs. Medical Teacher, 32(8), 646 – 650. https://doi.org/10.3109/0142159x.2010.500703. Medline:20662575

Henry, G. T., & Mark, M. M. (2003). Beyond use: Understanding evaluation’s influence on attitudes and actions. American Journal of Evaluation, 24(3), 293-314.

King, J. A. , & Ayoo, S. (2020). What do we know about evaluator education? A review of peer-reviewed publications (1978–2018) . Evaluation and Program Planning, 79, 101785. https://doi.org/10.1016/j.evalprogplan.2020.101785. Medline:32086100

King, J. A., & Stevahn, L. (2020). Presenting the 2018 AEA Evaluator Competencies. In J. A. King (Ed.), The American Evaluation Association’s Program Evaluator Competencies. New Directions for Evaluation, 2020, 49 – 61 .

Kuhlmann, E. G. (2009). Competency-based social work education: A thirty-year retrospective on the behavioral objectives movement. Social Work and Christianity, 36(1), 70 – 76 .

Downloads

Published

2023-04-21

How to Cite

LaVelle, J., & Johnson, D. (2023). Redesigning a University-Based Evaluator Education Program for Scholarship and Practice. Canadian Journal of Program Evaluation, 37(1), 117–134. https://doi.org/10.3138/cjpe.71430

Issue

Vol. 37 No. 1 (2022): Spring

Section

Research and Practice Notes

License

Copyright (c) 2022 John LaVelle, David Johnson

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.

Authors retain copyright of their work and grant the journal right of first publication.

Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.