Mapping the Contributions of John Mayne

Bridging the Gaps Between Evaluation, Auditing, and Performance Monitoring

Authors

  • Steffen Bohni Nielsen National Research Centre for the Working Environment, Copenhagen, Denmark
  • Stinne Tangsig Agency for Public Finance and Management, Copenhagen, Denmark
  • Sebastian Lemire Abt Associates, Rockville, Maryland

DOI:

https://doi.org/10.3138/cjpe.75441

Keywords:

John Mayne, contribution analysis, citation metrics, academic impact, research on evaluation

Abstract

The late John Mayne’s contribution to evaluation was significant. This article maps his written contributions to evaluation. The authors analyze the number and types of publications produced by John Mayne from 1981 to 2020. They also identify the main themes in his authorship, and how they evolved over time. They further identify his most notable publications and use standard citation metrics to assess his academic impact. Finally, they take stock of his publications record and academic impact and conclude that his contribution to the evaluation community was significant and comparable to other thought leaders in the field of evaluation.

References

Aksnes, D. W., Langfeldt, L., & Wouters, P. (2019). Citations, citation indicators, and research quality: An overview of basic concepts and theories. Sage Open, 9(1), 1–17.

Auditor General of Canada. (1999). Involving others in governing accountability at risk. Report of the Auditor General to the House of Commons. Ottawa.

Barrados, M. (2023). John Mayne’s contribution to performance audit. Canadian Journal of Program Evaluation, 37(3), 461–472.

Barrados, M., & Mayne, J. (2003). Can public sector organisations learn? OECD Journal of Budgeting, 3(3), 87–103.

Befani, B., & Mayne, J. (2014). Process tracing and contribution analysis: a combined approach to generative causal inference for impact evaluation. IDS Bulletin, 45(6), 17–36.

Birch, L., & Jacob, S. (2010). The intellectual underpinnings of a comprehensive body of evaluative knowledge: the case of INTEVAL. In J. Vaessen and F. L. Leeuw (Eds.), Mind the gap. Perspectives on policy evaluation and the social sciences, pp. 91–120. New York, NY: Transactions.

Bourgeois, I., & Whynot, J. (2023). Bridging evaluation theory and practice: The contributions of John Mayne to Canadian federal evaluation. Canadian Journal of Program Evaluation, 37(3), 324–339.

Chaytor, K. (2023). Building evaluation culture—The missing link. Canadian Journal of Program Evaluation, 37(3), 422–438.

Dybdal, L., Nielsen, S. B., & Lemire, S. (2010). Contribution analysis applied: reflections on scope and methodology. Canadian Journal of Program Evaluation, 25(2), 29–57.

Government of Canada. Government Review and Quality Services & Treasury Board Secretariat. Public Affairs Branch. (1998). Program evaluation methods: Measurement and attribution of program results (3rd edition). Public Affairs Branch, Treasury Board of Canada Secretariat.

Harzing, A. W., & Alakangas, S. (2016). Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary comparison, Scientometrics, 106(2), 787–804.

Lahey, R. (2023). John Mayne and the origins of evaluation in the public sector in Canada: A shaping of both evaluation and the evaluator. Canadian Journal of Program Evaluation, 37(3), 340–354.

Leeuw, F. L. (2023). John Mayne and rules of thumb for contribution analysis: a comparison with two related approaches. Canadian Journal of Program Evaluation, 37(3), 403–421.

Mayne, J. (1994). Utilizing evaluation in organizations: the balancing act. In F. L. Leeuw, R. C. Rist, and R. C. Sonnichsen (Eds.), Can governments learn? London, UK: Routledge.

Mayne, J. (1999). Addressing attribution through contribution analysis: Using performance measures sensibly. Discussion paper. Office of the Auditor General of Canada. Retrieved from http://dsp-psd.pwgsc.gc.ca/Collection/FA3-31-1999E.pdf

Mayne, J. (2001). Addressing attribution through contribution analysis: Using performance measures sensibly. Canadian Journal of Program Evaluation, 16(1), 1–24.

Mayne, J. (2004). Reporting on outcomes: Setting performance expectations and telling performance stories. Canadian Journal of Program Evaluation, 19(1), 31–60.

Mayne, J. (2006). Audit and evaluation in public management: Challenges, reforms, and different roles. Canadian Journal of Program Evaluation, 21(1), 11–45.

Mayne, J. (2007). Challenges and lessons in implementing results-based management. Evaluation, 13(1), 87–109.

Mayne, J. (2008a). Contribution analysis: An approach to exploring cause and effect. Rome, Italy: Institutional Learning and Change (ILAC) Initiative, ILAC Brief 16, 1–4.

Mayne, J. (2008b). Building an evaluative culture for effective evaluation and results management. Rome, Italy: Institutional Learning and Change (ILAC) Initiative, ILAC Brief # 20, 1–4.

Mayne, J. (2012). Contribution analysis: Coming of age? Evaluation, 18(3), 270–280.

Mayne, J. (2015). Useful theory of change models. Canadian Journal of Program Evaluation, 30(2), 119–142.

Mayne, J. (2017). Theory of change analysis: Building robust theories of change. Canadian Journal of Program Evaluation, 32(2), 155–173.

Mayne, J., & Johnson, N. (2015). Using theories of change in the CGIAR Research Program on Agriculture for Nutrition and Health. Evaluation, 21(4), 407–428.

Mayne, J., & Rist, R. C. (2006). Studies are not enough: The necessary transformation of evaluation. Canadian Journal of Program Evaluation, 21(3), 93–120.

Mayne, J., & Stern, E. (2013). Impact evaluation of natural management research programs: A broader view. Technical report. ACIAR Impact Assessment Series Report No. 84. Canberra: Australian Centre for International Agriculture Research (ACIAR).

McDavid, J. (2023). Enduring Themes in John Mayne’s Work: Implications for Evaluation Practice. Canadian Journal of Program Evaluation, 37(3), 355–370.

Nielsen S. B., Lemire, S., & Montague, S. (2023). Remembering John Mayne—A practical thinker and a thinking practitioner. Canadian Journal of Program Evaluation, 37(3), 297–305.

Nielsen S. B., & Montague, S. (2023). John Mayne’s contribution to result-based management thinking: A leadership legacy. Canadian Journal of Program Evaluation, 37(3), 439–460.

ResearchGate. (2021). John Mayne profile. Retrieved October 19, 2021 from https://www.researchgate.net/profile/John-Mayne-2

Schwartz, R., & Mayne, J. (2005a). Assuring the quality of evaluative information: Theory and practice. Evaluation and Program Planning, 28(1), 1–14.

Schwartz, R., & Mayne, J. (2005b). Quality matters: Seeking confidence in evaluating, auditing and performance reporting. London, UK: Routledge.

Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R., & Befani, B. (2012). DFID Working Paper 38. Broadening the range of designs and methods for impact evaluations. London, UK: DFID. Retrieved from https://www.gov.uk/research-for-development-outputs/dfid-working-paper-38-broadening-the-range-of-designs-and-methods-for-impact-evaluations

Sørensen, O. H., Bjørner, J., Dyreborg, J., Kristiansen, J., Sørli, J. B., & Nielsen, S. B. (2022). Measuring societal impact of research. Developing and validating an impact instrument for occupational health and safety. Research Evaluation, 31(1), 118–131.

Downloads

Published

2023-03-17

How to Cite

Bohni Nielsen, S., Tangsig, S., & Lemire, S. (2023). Mapping the Contributions of John Mayne: Bridging the Gaps Between Evaluation, Auditing, and Performance Monitoring. Canadian Journal of Program Evaluation, 37(3), 306–323. https://doi.org/10.3138/cjpe.75441

Issue

Section

Articles

Most read articles by the same author(s)

1 2 > >>