The (im)possibility of monitoring and evaluating the impact of community engagement performance in South African universities: A review
Abstract
Monitoring and evaluation (M&E) allow universities to learn from past experiences, improve service delivery, plan, and allocate resources and demonstrate results as part of their accountability to stakeholders. M&E also assists in keeping projects on track, providing a basis for reassessing priorities and creating evidence-based data for projects. Considerable scholarship is illuminating insights and sharing experiences of community engagement in higher education. However, the question of M&E remains contestable due to the complexities in implementing community engagement in higher education. This article discusses the (im)possibility of facilitating M&E in higher education community engagement spaces. In 2009, the University of Venda established a directorate for community engagement, which I became its first director. I use the insider lens to reflect on the intersections of concepts and constructs such as knowledge co-production, ecosystems, societal impact, and an M&E framework in higher education. I intend here to bring some problems and contestations in generating a framework for monitoring and reviewing community engagement, arguing that the framework should embrace multiple ontologies and be intentional about robust engagement with epistemological, ontological, and ethical questions around exclusivity and dominance. Hopefully I will add a much-needed dimension acknowledging the complexity of a community engagement discourse – toward an inclusive, participatory-ecosystemic way of self-assessment, monitoring and evaluation.
References
Adner, Ron. 2017. “Ecosystem as structure: An actionable construct for strategy.” Journal of Management 43(1): 39‒58.
Adner, Ron and Rahul Kapoor. 2010. “Value creation in innovation ecosystems: How the structure of technological interdependence affects firm performance in new technology generations.” Strategic Management Journal 31(3): 306‒333.
Bhagwan, Raisuyah. 2017. “Towards a conceptual understanding of community engagement in higher education in South Africa.” Perspectives in Education 35(1): 171‒185.
Bamberger, Michael. 1991. “The politics of evaluation in developing countries.” Evaluation and Program Planning 14(4): 325‒339.
Banks, Sarah and Hugh Butcher. 2013 “What is community practice?” Managing community practice: Principles, policies and programmes, 7‒29.
Bender, Cornelia Johanna Gertruida. 2008. “Exploring conceptual models for community engagement at higher education institutions in South Africa”. Perspectives in Education 26(1): 81–95.
Bhola, Harbans Singh. 2003. Social and cultural contexts of educational evaluation: A global perspective. In International handbook of educational evaluation, ed. Thomas Kellaghan and Daniel L. Stufflebeam, 397–416. Boston: Kluwer.
Boyer, Ernest. 1996a. “The scholarship of Engagement.” Journal of Public Service and Outreach (1): 11‒20.
Boyer, Ernest. 1996b. “From scholarship reconsidered to scholarship assessed.” Quest 48(2): 129‒139.
Braidotti, Rosi. 2019. “A theoretical framework for the critical posthumanities.” Theory, Culture & Society 36(6): 31‒61.
Brink, Chris. 2018. The Soul of a University: Why excellence Is Not Enough. Policy Press.
Chen, Huey Tsyh. 2006. “A theory-driven evaluation perspective on mixed methods research.” Research in the Schools 13(1): 75‒83.
Chilisa, Bagele. 2017. “Decolonising transdisciplinary research approaches: An African perspective for enhancing knowledge integration in sustainability science.” Sustainability Science 12(5): 813‒827.
Chilisa, Bagele and Donna M. Mertens. 2021. “Indigenous made in Africa evaluation frameworks: Addressing epistemic violence and contributing to social transformation.” American Journal of Evaluation 42(2): 241‒253.
Chilisa, Bagele, Thenjiwe Emily Major, and Kelne Khudu-Petersen. 2017. “Community engagement with a postcolonial, African-based relational paradigm.” Qualitative Research 17(3): 326‒339.
Chilisa, Bagele, Thenjiwe Emily Major, Michael Gaotlhobogwe, and Hildah Mokgolodi. 2015 “Decolonizing and indigenizing evaluation practice in Africa: Toward African relational evaluation approaches.” Canadian Journal of Program Evaluation 30(3): 313‒328.
Chouinard, Jill Anne and J. Bradley Cousins. 2015. “The Journey from Rhetoric to Reality: Participatory Evaluation in a Development Context.” Educational Assessment, Evaluation and Accountability 27(1): 5–39. doi:10.1007/S11092-013-9184-8.
Clayss ‒ Centro Latinoamericano de Aprendizaje y Servicio Solidario, www.clayss.org.
Connell, Raewyn. 2016. “Masculinities in global perspective: Hegemony, contestation, and changing structures of power.” Theory and Society 45(4): 303‒318.
Cornwall, Andrea. 2008. “Unpacking ‘Participation’: Models, meanings and practices.” Community Development Journal 43(3): 269‒283.
Cooper, David. 2011. “The University in Development: Case Studies of Use-oriented Research.” HSRC Press.
Council on Higher Education. 2021. Framework for Institutional Audits. Pretoria: CHE.
Council on Higher Education. 2004. Framework for Institutional Audits. Pretoria: CHE.
Crawford, Paul and Paul Bryce. 2003. “Project monitoring and evaluation: a method for enhancing the efficiency and effectiveness of aid project implementation.” International Journal of Project Management 21(5): 363‒373.
Cullen, Anne and Chris L. S. Coryn. 2011. “Forms and functions of participatory evaluation in international development: A review of the empirical and theoretical literature.” Journal of MultiDisciplinary Evaluation 7(16): 32‒47.
Department of Education. 1997. Education White Paper No. 3: A programme on the transformation of higher education transformation. Pretoria: Government Printers.
Department of Education. 1998. Higher Education Amendment Act. Pretoria: Government Printers.
Department of Education. 2001. National Plan for Higher Education. Pretoria: Government Printers.
DoE see Department of Education.
Ebrahim, Alnoor and Kasturi Rangan. 2014. “What impact? A framework for measuring the scale and scope of social performance.” California Management Review 56(3): 118‒141.
Etzioni, Amitai. 1995a. “The spirit of community, rights, responsibilities, and the communitarian agenda.” New Statesman and Society 8(377): 34‒35.
Etzioni, Amitai. 1995b. The spirit of community: rights, responsibilities and the communitarian agenda. London: Fontana.
Fals-Borda, Orlando. 1987. “The application of participatory action-research in Latin America.” International sociology 2(4): 329‒347.
Galan-Muros, Victoria and Todd Davey. 2019. “The UBC ecosystem: Putting together a comprehensive framework for university-business cooperation.” The Journal of Technology Transfer 44(4): 1311‒1346.
Gibbons, Michael. 2006. “Engagement as a core value in a mode 2 society.” Paper presented at the CHE-HEQC/JET-CHESP Conference on Community Engagement in Higher Education. 3 to 5 September 2006, Cape Town, South Africa.
Global University Network for Innovation (GUNI). https://www.guninetwork.org/. (Accessed 20 May 2022.)
Greenaway, Alison, Holden Hohaia, Erena Le Heron, Richard Le Heron, Andrea Grant, Gradon Diprose, Nicholas Kirk, and Will Allen. 2022. “Methodological sensitivities for co-producing knowledge through enduring trustful partnerships.” Sustainability Science 17(2): 433‒447.
Gordon, Ray and David Grant. 2004. “Knowledge management or management of knowledge? Why people interested in knowledge management need to consider Foucault and the construct of power.” Tamara: Journal for Critical Organization Inquiry 3(2): 27‒38.
Hagendijk, Rob. 2015. “Sense and sensibility: Science, society and politics as co-production.” In Science and Democracy: Making Knwoledge and making power in the bioscience and beyond, ed. Stephen Hilgartner, Clark A. Miller and Rob Hagendijk, 238‒256. New York: Routledge.
Hart, Angie and Simon Northmore. 2011. “Auditing and evaluating university-community engagement: Lessons from a UK case study.” Higher Education Quarterly 65(1): 34‒58.
HEQC see Higher Education Quality Committee.
Higher Education Quality Committee. 2001. “The founding documents of the HEQC.” www.che.ac.za/media_and_publications/heqc/higher-education-quality-committee-heqc-founding-document. (Accessed 29 June 2014).
Hoppers, Catherine Alum Odora. (Ed.). 2002. Indigenous Knowledge and the Integration of Knowledge Systems: Towards a philosophy of articulation. Claremont: New Africa Books.
Keane, Moyra, Constance Khupe, and Maren Seehawer. 2017. “Decolonising methodology: Who benefits from indigenous knowledge research?” Educational Research for Social Change 6(1): 12‒24.
Kemmis, Stephen. 2022. “Participatory action research: Methodologies for transformation.” Webinar presentation, Collaborative universities (University of Mpumalanga, University of Venda, Central University of Technology). 29 June 2022.
Kemmis, Stephen, Jane Wilkinson, Christine Edwards-Groves, Ian Hardy, Peter Grootenboer, and Laurette Bristol. (Eds.). 2014. “Praxis, practice and practice architectures.” In Changing Practices, Changing Education, 25‒41. Singapore: Springer.
Khupe, Constance and Moyra Keane. 2017. “Towards an African education research methodology: Decolonising new knowledge.” Educational Research for Social Change 6(1): 25‒37.
Limoges, Camille, Peter Scott, Simon Schwartzman, Helga Nowotny, and Michael Gibbons. 1994. The new production of knowledge: The dynamics of science and research in contemporary societies. London: Sage publications.
Lusch, Robert F. and Satish Nambisan. 2015. “Service innovation.” MIS quarterly 39(1): 155‒176.
Maas, Karen and Kellie Liket. 2011. “Social impact measurement: Classification of methods.” In Environmental management accounting and supply chain management, ed. R. L. Burritt et al.,171‒202. Dordrecht: Springer.
Mbah, Marcellus, Ane T. Johnson, and Ferdinand M. Chipindi. 2021. “Institutionalizing the intangible through research and engagement: Indigenous knowledge and higher education for sustainable development in Zambia.” International Journal of Educational Development 82(2021): 102355. https://doi.org/10.1016/j.ijedudev.2021.102355. 1‒7.
Markiewicz, Anne and Ian Patrick. 2015. Developing monitoring and evaluation frameworks. London: Sage Publications.
Maughan, Catherine. 2012. “Monitoring and evaluating social impacts in Australia.” Cooperative Research Centre for Remote Economic Participation (CRC-REP) Working Papers (Vol. CW003). Alice Springs: Ninti One Limited.
Nkoana, E. and M. Dichaba. 2017. “Development and application of conceptual and analytic frameworks for community engagement at a South African higher education institution.” South African Journal of Higher Education 31(6): 177‒196.
Nkoana, Elvis Modikela and Mpho Mildred Dichaba. 2016. “Are We Heading in The Right Direction? Assessing University-Community Engagement Dimensions of a South African Higher Education Institutions.” Proceedings of the University of South Africa (UNISA) International Conference on Education, Towards Excellence in Educational Practices. Pretoria, South Africa. (Online).
Patton, Michael Quinn. 1994. “Developmental evaluation.” Evaluation Practice 15(3): 311‒319.
Schön, Donald A. 1995, “Knowing-in-action: The new scholarship requires a new epistemology. Change: The Magazine of Higher Learning 27(6): 27‒34.
Society for Participatory Research in Asia (PRIA). https://www.unescochair-cbrsr.org/. (Accessed 1 April 2022).
Talloires network. https://talloiresnetwork.tufts.edu/who-we-are/.
Tapia, Maria Nieves. 2012. “Academic excellence and community engagement: Reflections on the Latin American experience.” In Higher Education and Civic Engagement, ed. L. McIlrath, A. Lyons, and R. Munck, 187‒203. Palgrave Macmillan, New York.
Vincent, Katharine, Meaghan Daly, Claire Scannell, and Bill Leathes. 2018. “What can climate services learn from theory and practice of co-production?” Climate Services (12): 48‒58.
Visman, Emma, Katharine Vincent, Anna Steynor, Irene Karani, and Emmah Mwangi. 2022. “Defining metrics for monitoring and evaluating the impact of co-production in climate services.” Climate Services (26): 100297.
Vogel, Coleen, Anna Steynor, and Albert Manyuchi. 2019. “Climate services in Africa: Re-imagining an inclusive, robust and sustainable service.” Climate Services 15: Article 100107. 10.1016/j.cliser.2019.100107.
West, Simon and Caroline Schill. 2022. “Negotiating the ethical-political dimensions of research methods: A key competency in mixed methods, inter-and transdisciplinary, and co-production research.” Humanities and Social Sciences Communications 9(1): 1‒13.
Copyright (c) 2022 VHONANI OLIVE NETSHANDAMA
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This journal is an open access journal, and the authors and journal should be properly acknowledged, when works are cited.
Authors, copyright holders, may use the publishers version for teaching purposes, in books, theses, dissertations, conferences and conference papers.
A copy of the authors' publishers version may also be hosted on the following websites:
- Non-commercial personal homepage or blog.
- Institutional webpage.
- Authors Institutional Repository.
The following notice should accompany such a posting on the website: This is an electronic version of an article published in SAJHE, Volume XXX, number XXX, pages XXX “XXX", DOI. Authors should also supply a hyperlink to the original paper or indicate where the original paper (http://www.journals.ac.za/index.php/SAJHE) may be found.
Authors publishers version, affiliated with the Stellenbosch University will be automatically deposited in the University Institutional Repository SUNScholar.
Articles as a whole, may not be re-published with another journal.
The following license applies:
Attribution CC BY-NC-ND 4.0
