The Evaluation Marketplace in Canada

What Qualifications Do Employers Demand?

Authors

  • Dave Guyadeen School of Environmental Design and Rural Development, University of Guelph, Guelph, Ontario
  • Hanna Holman School of Environmental Design and Rural Development, University of Guelph, Guelph, Ontario
  • Daniel Henstra Department of Political Science, University of Waterloo, Waterloo, Ontario

DOI:

https://doi.org/10.3138/cjpe.72343

Keywords:

evaluation practice, evaluation education, evaluation skills and knowledge, evaluation credentialing

Abstract

This study examined the key qualifications—education, knowledge areas, professional qualities, skills, and tasks—demanded of evaluators by employers in the public, private, and not-for-profit sectors. Through a content analysis of 50 employment advertisements, it found that the qualifications demanded by employers generally align with the skills identified as important in the evaluation literature and with competencies identified by the Canadian Evaluation Society. The study also found that there is an opportunity to promote the Credentialed Evaluator (CE) designation to those interested in enhancing the evaluation capacity of their organizations.

References

Alkin, M. C. (2013). Evaluation roots: A wider perspective of theorists’ views and influences. Thousand Oaks, CA: SAGE.

ANZEA. (2011). Aotearoa New Zealand Evaluation Association (ANZEA) 2011 evaluator competencies. Retrieved fromhttps://www.anzea.org.nz/app/uploads/2019/04/110801_anzea_evaluator_competencies_final.pdf

Baker, I., Peterson, A., Brown, G., & McAlpine, C. (2012). Local government response to the impacts of climate change: An evaluation of local climate change plans. Landscape and Urban Planning, 107 (2), 127–136. https://doi.org/10.1016/j.landurbplan.2012.05.009

Beywl, W., & Harich, K. (2007). University-based continuing education in evaluation: The baseline in Europe. Evaluation, 13(1), 121–134. https://doi.org/10.1177/1356389007073685

Brandon, P. R., Smith, N. L., & Hwalek, M. (2011). Aspects of successful evaluation practice at an established private evaluation firm. American Journal of Evaluation, 32(2), 295–307. https://doi.org/10.1177/1098214011401369

Canadian Evaluation Society. (2010). Competencies for Canadian evaluation practice . Retrieved from https://evaluationcanada.ca/txt/2_competencies_cdn_evaluation_practice_2010.pdf

Canadian Evaluation Society. (2014). Competencies for Canadian evaluators. Retrieved from https://evaluationcanada.ca/competencies-canadian-evaluators

Canadian Evaluation Society. (2018). Competencies for Canadian evaluation practice. Retrieved from https://evaluationcanada.ca/txt/2_competencies_cdn_evaluation_practice.pdf

Christie, C. A., Quinones, P., & Fierro, L. (2014). Informing the discussion on evaluator training: A look at evaluators’ course taking and professional practice. American Journal of Evaluation, 35 (2), 274–290. https://doi.org/10.1177/1098214013503697

Christie, N. V. (2012). An interpersonal skills learning taxonomy for program evaluation instructors. Journal of Public Affairs Education, 18(4), 739–756. https://doi.org/10.1080/15236803.2012.12001711

Cousins, J. B. (2004). Crossing the bridge: Toward understanding through systematic inquiry. In M. C. Alkin (Ed.), Evaluation roots (pp. 293–318). Thousand Oaks, CA: SAGE.

Davies, R., & Mackay, K. (2014). Evaluator training: Content and topic valuation in university evaluation courses. American Journal of Evaluation, 35(3), 419–429. https://doi.org/10.1177/1098214013520066

Dewey, J. D., Montrose, B. E., Schroter, D. C., Sullins, C. D., & Mattox, J. R., III (2008). Evaluator competencies: What’s taught versus what’s sought. American Journal of Evaluation, 29 (3), 268–287. https://doi.org/10.1177/1098214008321152

Dillman, L. M. (2012). Evaluator skill acquisition: Linking educational experience to competencies. American Journal of Evaluation, 34(2), 270–285. https://doi.org/10.1177/1098214012464512

Fetterman, D. M. (2004). Branching out or standing on a limb: Looking to our roots for insight. In M. C. Alkin (Ed.), Evaluation roots (pp. 304–318). Thousand Oaks, CA: SAGE.

Galport, N., & Azzam, T. (2017). Evaluator training needs and competencies: A gap analysis. American Journal of Evaluation, 38(1), 80–100. https://doi.org/10.1177/1098214016643183

Ghere, G., King, J. A., Stevahn, L., & Minnema, J. (2006). A professional development unit for reflecting on program evaluator competencies. American Journal of Evaluation, 27 (1), 108–123. https://doi.org/10.1177/1098214005284974

Gullickson, A. M., King, J. A., LaVelle, J. M., & Clinton, J. M. (2019). The current state of evaluator education: A situation analysis and call to action. Evaluation and Program Planning, 75 , 20–30. https://doi.org/10.1016/j.evalprogplan.2019.02.012

Guyadeen, D., & Henstra, D. (2021). Competing in the planning marketplace: An analysis of qualifications demanded by municipal planning recruiters. Journal of Planning Education and Research, in press (June).

Guyadeen, D., & Seasons, M. (2018). Evaluation theory and practice: Comparing program evaluation and evaluation in planning. Journal of Planning Education and Research, 38 (1), 98–110.

King, J. A., & Stevahn, L. (2021). Presenting the 2018 AEA evaluator competencies. New Directions for Evaluation, 2020 (168), 49–61. https://doi.org/10.1002/ev.20435

King, J. A., Stevahn, L., Ghere, G., & Minnema, J. (2001). Toward a taxonomy of essential evaluator competencies. American Journal of Evaluation, 22(2), 229–247. https://doi.org/10.1177/109821400102200206

Kirkhart, K. (1981). Defining evaluator competencies: New light on an old issue. Evaluation News, 2 (2), 188–192. https://doi.org/10.1177/109821408100200225

Krippendorff, K. (2013). Content analysis: An introduction to its methodology (3rd ed.). Thousand Oaks, CA: SAGE.

LaVelle, J. M. (2011). Planning for evaluation’s future: Undergraduate students’ knowledge of and interest in program evaluation. American Journal of Evaluation, 32 (3), 362–375. https://doi.org/10.1177/1098214011398953

LaVelle, J. M. (2014). An analysis of evaluation education programs and evaluator skills across the world (Unpublished dissertation). Claremont, CA: Claremont Graduate University.

LaVelle, J. M. (2020). Educating evaluators 1976–2017: An expanded analysis of university-based evaluation education programs. American Journal of Evaluation, 41(4), 494–509. https://doi.org/10.1177/1098214019860914

LaVelle, J. M., & Donaldson, S. L. (2015). The state of preparing evaluators. New Directions for Program Evaluation, 145 , 39–52. https://doi.org/10.1002/ev.20110

Leeuw, F. L. (2009). Evaluation: A booming business but is it adding value? Evaluation Journal of Australia, 9 (1), 3–9. https://doi.org/10.1177/1035719X0900900102

McGure, M., & Zorzi, R. (2005). Evaluator competencies and performance development. Canadian Journal of Program Evaluation, 20 (2), 73–99.

Mertens, D. M. (1994). Training evaluators: Unique skills and knowledge. New Directions for Program Evaluation, 62 , 17–27. https://doi.org/10.1002/ev.1673

Nielsen, S. B., Lemire, S., & Christie, C. A. (2018). The evaluation marketplace and its industry. New Directions for Program Evaluation, 160, 13–28. https://doi.org/10.1002/ev.20344

Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: Guilford Press.

Picciotto, R. (2011). The logic of evaluation professionalism. Evaluation, 17 (2), 165–180. https://doi.org/10.1177/1356389011403362

Rodriguez-Campos, L. (2012). Advances in collaborative evaluation. Evaluation and Program Planning, 35 (4), 523–528. https://doi.org/10.1016/j.evalprogplan.2011.12.006

Schwandt, T. A. (2008). Educating for intelligent belief in evaluation. American Journal of Evaluation, 29 (2), 139–150.

Schwandt, T. A. (2017). Professionalization, ethics, and fidelity to an evaluation ethos. American Journal of Evaluation, 38 (4), 546–553.

Scriven, M. (1996). Types of evaluation and types of evaluator. Evaluation Practice, 17(2), 151–161. https://doi.org/10.1177/109821409601700207

Stevahn, L., King, J. A., Ghere, G., & Minnema, J. (2005). Establishing essential competencies for program evaluators. American Journal of Evaluation, 26(1), 43–59. https://doi.org/10.1177/1098214004273180

Downloads

Published

2023-04-21

How to Cite

Guyadeen, D., Holman, H., & Henstra, D. (2023). The Evaluation Marketplace in Canada: What Qualifications Do Employers Demand?. Canadian Journal of Program Evaluation, 37(2), 167–185. https://doi.org/10.3138/cjpe.72343

Issue

Vol. 37 No. 2 (2022): Fall

Section

Articles

License

Copyright (c) 2023 Dave Guyadeen, Hanna Holman, Daniel Henstr

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.

Authors retain copyright of their work and grant the journal right of first publication.

Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.