Scope Creep and Purposeful Pivots in Developmental Evaluation
DOI:
https://doi.org/10.3138/cjpe.56898Keywords:
capacity building, complexity theory, developmental evaluation, higher education, online learningAbstract
This practice note illustrates a situation where, as program evaluators, we crept beyond the provisional boundaries set by our Developmental Evaluation (DE) goals to facilitate learning. Our DE was initially focused on one program which was being designed for online delivery in higher education. During the DE of this program, questions and themes arose which had larger organizational applicability; we were asked to help design a strategic learning session that addressed a large group of stakeholders within which existed the tiny subset of stakeholders engaged in the original DE. This practice note describes how we negotiated the emergent purposes of the DE with the need for intentional pivots within the strategic learning session to serve our intended subset of stakeholders with their project as well as stimulate evaluative thinking within the larger stakeholder group.
References
Brinkley-Etzkorn, K. E. (2018). Learning to teach online: Measuring the influence of faculty development training on teaching effectiveness through a TPACK lens. The Internet and Higher Education, 38, 28 – 35. https://doi.org/10.1016/j.iheduc.2018.04.004
Canadian Evaluation Society (CES). (2010). Competencies for Canadian evaluation practice. Retrieved from https://evaluationcanada.ca/txt/2_competencies_cdn_evaluation_practice.pdf
Christie, M., & Garrote Jurado, R. (2009). Barriers to innovation in online pedagogy. European Journal of Engineering Education, 34(3), 273 – 279. https://doi.org/10.1080/03043790903038841
Gary, L. (2005). Will project creep cost you—or create value? Harvard Management Update, 10(1), 3 – 5.
Goldstein, H., Bergman, E. M., & Maier, G. (2013). University mission creep? Comparing EU and US faculty views of university involvement in regional economic development and commercialization. Annals of Regional Science, 50(2), 453 – 477. https://doi.org/10.1007/s00168-012-0513-5
Groff, T., & Jones, T. (2012). Introduction to knowledge management. New York, NY: Routledge.
Jonker, K., & Meehan, W. F., III (2008). Curbing mission creep. Stanford Social Innovation Review, 6(1), 60 – 65.
Kendrick, T. (2015). Identifying and managing project risk: Essential tools for failure-proofing your project. New York, NY: AMACOM.
Lam, C. Y., & Shulha, L. M. (2015). Insights on using developmental evaluation for innovating: A case study on the cocreation of an innovative program. American Journal of Evaluation, 36(3), 358 – 374. https://doi.org/10.1177/1098214014542100
McElhinney, D., & Proctor, T. (2005). Concept of entrapment and decision-making. Management Decision, 43(2), 189 – 202. https://doi.org/10.1108/00251740510581911
Mikkelsen, M. F. (2018). Projects, success, and complexity. International Project Management Association Research Conference 2017. Sydney, Australia: UTS ePRESS.
Milley, P., Szijarto, B., Svensson, K., & Cousins, J. B. (2018). The evaluation of social innovation: A review and integration of the current empirical knowledge base. Evaluation, 24(2), 237 – 258. https://doi.org/10.1177/1356389018763242
Patton, M. Q. (1994). Developmental evaluation. American Journal of Evaluation, 15(3), 311 – 319. https://doi.org/10.1177/109821409401500312
Patton, M. Q. (1996). A world larger than formative and summative. Evaluation Practice, 17(2), 131 – 144. https://doi.org/10.1177/109821409601700205
Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Thousand Oaks, CA: Sage Publications.
Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: Guilford Press.
Patton, M. Q., McKegg, K., & Wehipeihana, N. (2015). Developmental evaluation exemplars: Principles in practice. New York, NY: The Guilford Press.
Preskill, H., & Beer, T. (2012). Evaluating social innovation. Washington, DC: FSG and the Centre for Evaluation Innovation. Retrieved from http://www.evaluationinnovation.org/sites/default/files/EvaluatingSocialInnovation.pdf
Shulha, L. M., Whitmore, E., Cousins, J. B., Gilbert, N., & al Hudib, H. (2016). Introducing evidence-based principles to guide collaborative approaches to evaluation: Results of an empirical process. American Journal of Evaluation, 37(2), 193 – 215. https://doi.org/10.1177/1098214015615230
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2020 Suparna Roy, Michelle Searle
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
