Methods to Make Sense of Resilience
Lessons From Participant Coded Micronarratives
DOI:
https://doi.org/10.3138/cjpe.71436Keywords:
evaluation, mixed methods, qualitative research, participation, narrativesAbstract
The Okavango and Limpopo river basins are challenged by the effects of climate change, where communities that are traditionally dependent on natural resources for their livelihoods must adapt to conditions less predictable. Divergent interests among various stakeholders contribute to tensions between livelihoods and conservation, and understanding the perspectives of communities is critical for planning. However, traditional methodological tools are not adequate to reflect the diverse perspectives of respondents at scale. A baseline study of community resilience approaches to adapt to climate change across both river basin areas used a participant-coded micro-narrative approach to establish how people understand resilience across diverse areas. This methodological approach holds potential as a framework for understanding community experiences, but even methodologies designed for participation have limits in both processes and results. This article explores both and presents potential uses for participant-coded narratives in future evaluation processes.
References
Ahern, N. R., Kiehl, E. M., Lou Sole, M., & Byers, J. (2006). A review of instruments measuring resilience. Issues in Comprehensive Pediatric Nursing, 29(2), 103–125.
Bartels, S. A., Michael, S., Vahedi, L., Collier, A., Kelly, J., Davison, C., & Geara, P. (2019). SenseMaker® as a monitoring and evaluation tool to provide new insights on gender-based violence programs and services in Lebanon. Evaluation and Program Planning, 77, 101715.
Benjamin, L. M. (2021). Beyond programs: toward a fuller picture of beneficiaries in nonprofit evaluation. In A research agenda for evaluation (pp. 81–103). Edward Elgar Publishing.
Bradbury, J. (2017). Creative twists in the tale: Narrative and visual methodologies in action. Psychology in Society, (55), 14–37.
Brown, A. D., Stacey, P., & Nandhakumar, J. (2008). Making sense of sensemaking narratives. Human Relations, 61(8), 1035–1062.
Callaghan, M. A., Watchiba, D., Purkey, E., Davison, C. M., Aldersey, H. M., & Bartels, S. A. (2021). “I don’t know where i have to knock for support”: A mixed-methods study on perceptions and experiences of single mothers raising children in the Democratic Republic of Congo. International Journal of Environmental Research and Public Health, 18(19), 10399.
Carvalhaes, T., Rinaldi, V., Goh, Z., Azad, S., Uribe, J., Chester, A., & Ghandehari, M. (2021). Integrating spatial and ethnographic methods for resilience research: A thick mapping approach for Hurricane Maria in Puerto Rico. Available at SSRN 3863657.
Deprez, S., Huyghe, C., & Van Gool Maldonado, C. (2012). Using Sensemaker to measure, learn and communicate about smallholder farmer inclusion. VECO. http://betterevaluation.org/resources/example/sensemaker_veco.
Hoffman, R. R., & Hancock, P. A. (2017). Measuring resilience. Human Factors, 59(4), 564–581.
Keith Norambuena, B. F., Mitra, T., & North, C. (2022). Design guidelines for narrative maps in sensemaking tasks. Information Visualization, 21(3), 220–245.
Korosteleva, E. A., & Petrova, I. (2021). What makes communities resilient in times of complexity and change? Cambridge Review of International Affairs. Advanced online publication.
Larson, A. (2018). Evaluation amidst complexity: Eight evaluation questions to explain how complex adaptive systems affect program impact. Evaluation, 24(3), 353–362.
Lee, S., & Bartels, S. A. (2019). Self-interpreted narrative capture: A research project to examine life courses of Amerasians in Vietnam and the United States. Methodological Innovations, 12(2), 2059799119863280.
Lee, S., Kim, S. H., Hung, Y. H., Lam, H., Kang, Y. A., & Yi, J. S. (2015). How do people make sense of unfamiliar visualizations?: A grounded model of novice’s information visualization sensemaking. IEEE Transactions on Visualization and Computer Graphics, 22(1), 499–508.
Mager, F., Smith, B., & Guijt, I. (2018). How decent is decent work? Using SenseMaker to understand workers’ experiences. Oxfam Open Repository.
Naumer, C., Fisher, K., & Dervin, B. (2008, April). Sense-Making: A methodological perspective [Paper presentation]. CHI Conference on Human Factors in Computing Systems, Florence, Italy.
Quandt, A. (2018). Measuring livelihood resilience: The household livelihood resilience approach (HLRA). World Development, 107, 253–263.
Syed, M., & Nelson, S. C. (2015). Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3(6), 375–387.
USAID. (2013). The resilience agenda: Measuring resilience in USAID.
Van der Merwe, S. E. (2019). Advancing resilience assessments: the social dimensions of electricity supply in South Africa [Doctoral dissertation, Stellenbosch University].
van der Merwe, S. E., Biggs, R., Preiser, R., Cunningham, C., Snowden, D. J., O’Brien, K., & Goh, Z. (2019). Making sense of complexity: Using sensemaker as a research tool. Systems, 7(2), 25.
van der Merwe, S. E., Biggs, R., & Preiser, R. (2020). Sensemaking as an approach for resilience assessment in an essential service organization. Environment Systems and Decisions, 40(1), 84–106.
Van Hemelrijck, A., & Goh, Z. (2015). Methodological reflections on the use of SenseMaker® for Impact M&E of Adaptation in the Mekong Delta. IFAD and Cognitive Edge.
Van Ongevalle, J., & Maarse, A. (2011, June 14–16). Planning, Monitoring and Evaluation of complex processes of social change. Towards a diverse PME approach [Paper presentation]. INTRAC’s 7th Evaluation Conference. Monitoring and evaluation: new developments and challenges, Soesterberg, The Netherlands.
Whiteman, G., & Cooper, W. H. (2011). Ecological sensemaking. Academy of Management Journal, 54(5), 889–911.
Winskell, K., Singleton, R., & Sabben, G. (2018). Enabling analysis of big, thick, long, and wide data: data management for the analysis of a large longitudinal and cross-national narrative data set. Qualitative Health Research, 28(10), 1629–1639.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Caitlin Blaser Mapitsa
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to The Canadian Journal of Program Evaluation agree to release their articles under the Creative Commons Attribution-Noncommercial 4.0 (CC-BY-NC) license. This licence allows this work to be copied, distributed, remixed, transformed, and built upon for any purpose provided that appropriate attribution is given, a link is provided to the license, and changes made were indicated.
Authors retain copyright of their work and grant the journal right of first publication.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
