Counting what counts: A researcher productivity scoring framework for South African's universities of technology
One of the three objectives of academic institutions all over the world is that of ensuring and upholding vibrant research productivity. For developing countries such as South Africa, public spending on research and development provides mechanisms for this. The South Africa’s Department of Higher Education and Training (DHET) is the custodian of government research funds. Evidence shows that DHET continues to grapple with the challenge of objectively measuring research productivity from the research funds invested in universities. The current funding framework applied by DHET has received numerous criticism one of them being its quantitative nature - it rewards quantity as opposed to quality research. This problem is more pronounced in Universities of Technology (UoTs) where, after more than ten years of operating as universities, the culture of research is not yet fully entrenched. Acknowledging the critical role played by research productivity measurements, we present a research productivity and quality measurement framework for UoTs. Using a case study of one of the UoTs, quantitative data relating to 48 aspects of the of existing research incentive system was used in determining the system’s effectiveness and efficacy in stimulating researchers’ activities. The proposed Framework consists of three components on: how to motivate researchers, what/how to measure research performance and how to incentivise researchers. Using an actual dataset of research outputs from the case study, an illustration on how to apply the framework has been provided. The results confirm our Framework’s ability to “count what counts” and proven the statement that “not everything that can be counted counts”.
Adler, Nancy J. and Anne Wil Harzing. 2009. “When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings.” Academy of Management Learning and Education. https://doi.org/10.5465/AMLE.2009.37012181.
Andersen, Lotte Bøgh and Thomas Pallesen. 2008. “‘Not Just for the Money?’ How Financial Incentives Affect the Number of Publications at Danish Research Institutions.” International Public Management Journal 11(1): 28–47. https://doi.org/10.1080/10967490801887889.
Bryman, A., E. Bell, P. Hirschsohn, A. dos Santos, J. du Toit, and A. Masenge. 2014. Research Methodology: Business and Management Contexts. Oxford University Press. https://doi.org/10.1016/S0048-7333(02)00072-0.
Bunting, Ian and Nico Cloete. 2010. Institutional Types in Higher Education in South Africa. Pretoria. https://doi.org/10.1080/07366981.2014.869962.
Carr, K. A. 2009. “Firms Find That Nonmonetary Rewards Count, Crain’s Cleveland Business.” Regional Business News 30(42).
Coyne, Imelda T. 1997. “Sampling in Qualitative Research. Purposeful and Theoretical Sampling; Merging or Clear Boundaries?” Journal of Advanced Nursing. https://doi.org/10.1046/j.1365-2648.1997.t01-25-00999.x.
Denrell, Jerker and Balázs Kovács. 2008. “Selective Sampling of Empirical Settings in Organizational Studies.” Administrative Science Quarterly. https://doi.org/10.2189/asqu.53.1.109.
Derrick, Gemma E. and Chris Bryant. 2013. “The Role of Research Incentives in Medical Research Organisations.” R and D Management 43(1): 75–86. https://doi.org/10.1111/radm.12001.
Department of Higher Education and Training. 2013. Report of the Ministerial Committee for the Review of the Funding of Universities. Pretoria. www.dhet.gov.za.
Department of Higher Education and Training. 2014a. DHET Research Agenda: 2014-2017. Pretoria. www.dhet.gov.za.
Department of Higher Education and Training. 2014b. “Ministerial Statement on University Funding: 2015/16 and 2016/17.” Pretoria. www.dhet.gov.za.
Department of Higher Education and Training. 2015a. Report on The Evaluation of the 2013 Universities’ Research Outputs. Pretoria. http://www.dhet.gov.za.
Department of Higher Education and Training. 2015b. “Research Output Policy (2015). Directorate: University Policy and Development Support.” Communiqué 2 of 2015 – August 2015, Vol. 597 11 March 2015, No. 38552. Pretoria.
Department of Higher Education and Training. 2017. Report on the Evaluation of the 2015 Universities’ Research Output. Pretoria. http://www.dhet.gov.za.
Department of Higher Education and Training. 2018a – “DHET accredited journals 2018”. Pretoria. https://www.dhet.gov.za/SitePages/UniversityEducation.aspx.
Department of Higher Education and Training. 2018b. Department of Higher Education and Training Annual Report 2016/17. Volume 5. Pretoria. http://www.dhet.gov.za
DHET see Department of Higher Education and Training.
Draucker, Claire B., Donna S. Martsolf, Ratchneewan Ross, and Thomas B. Rusk. 2007. “Pearls, Pith, and Provocation Theoretical Sampling and Category Development in Grounded Theory.” Qualitative Health Research 17(8): 1137–48. https://doi.org/10.1177/1049732307308450.
Fisher, J. G. 2008. How to Run Successful Employee Incentive Schemes: Creating Effective Programmes for Improved Performance. Vol. 3. London, Great Britain.
Frey, B. and S. Neckermann. 2008. “Awards: A View from Psychological Economics.” Journal of Psychology 216: 198–208.
Gendron, Yves. 2015. “Accounting Academia and the Threat of the Paying-off Mentality.” Critical Perspectives on Accounting 26: 168–76. https://doi.org/10.1016/j.cpa.2013.06.004.
Gliem, Rosemary R. and Joseph A. Gliem. 2003. “Calculating, Interpreting, and Reporting Cronbach’s Alpha Reliability Coefficient for Likert-Type Scales.” In Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education. https://doi.org/ 10.1109/PROC.1975.9792.
Green, Samuel B. 2016. Using SPSS for Windows and Macintosh: Analyzing and Understanding Data:Using SPSS for Windows and Macintosh: Analyzing and Understanding Data. American Statistician. https://doi.org/10.1198/tas.2005.s139.
Harley, Yolande X., Esmari Huysamen, Carlette Hlungwani, and Tania Douglas. 2016. “Does the DHET Research Output Subsidy Model Penalise High-Citation Publication? A Case Study.” South African Journal of Science 112(5/6): 3 Pages. https://doi.org/10.17159/sajs.2016/20150352.
Harzing, Anne Wil. 2013. “A Preliminary Test of Google Scholar as a Source for Citation Data: A Longitudinal Study of Nobel Prize Winners.” Scientometrics 94(3): 1057–1075. https://doi.org/10.1007/s11192-012-0777-7.
Humphrey, Christopher and Yves Gendron. 2015. “What Is Going on? The Sustainability of Accounting Academia.” Critical Perspectives on Accounting 26: 47–66. https://doi.org/ 10.1016/j.cpa.2014.09.008.
Larkin, I., L. Pierce, and F. Gino. 2012. “The Psychological Costs of Pay for Compensation of Employees.” Strategic Management Journal 33: 1194–1214.
Lobel, Jules. 2017. Chapter 4: Financing Research in Higher Education, 47–58. https://doi.org/ 10.1520/MNL10373M.
Mtshali, Mduduzi Nkosinathi Gladwin and Radhamany Sooryamoorthy. 2018. “A Research-Inducing Environment at a University of Technology in South Africa: Challenges and Future Prospects.” Futures June: 0–1. https://doi.org/10.1016/j.futures.2018.06.017.
Pinheiro, Rómulo, Patricio V. Langa, and Attila Pausits. 2015. “One and Two Equals Three? The Third Mission of Higher Education Institutions.” European Journal of Higher Education. https://doi.org/10.1080/21568235.2015.1044552.
Pouris, Androniki E. M. and Anastassios Pouris. 2015. “An Assessment of South Africa’s Research Journals: Impact Factors, Eigenfactors and Structure of Editorial Boards.” South African Journal of Science 111(3–4): 1–8. https://doi.org/10.17159/sajs.2015/20130358.
Reeve, Johnmarshall. 2012. “A Self-Determination Theory Perspective on Student Engagement.” In Handbook of Research on Student Engagement, 149–72. Boston, MA. https://doi.org/10.1007/978-1-4614-2018-7_7.
RSA Presidency. 2009. “Medium Term Strategic Framework (MTSF): A Framework to Guide Government”s Programme in the Electoral Mandate Period (2009 to 2014).” Pretoria. http://www.thepresidency.gov.za/docs/pcsa/planning/mtsf_july09.pdf.
Ryan, Richard M. and Edward L. Deci. 2000. “Self-Determination Theory and the Facilitation of Intrinsic Motivation, Social Development, and Well-Being.” American Psychologist. https://doi.org/10.1037/0003-066X.55.1.68.
Schroen, Anneke T., Monika J. Thielen, Florence E. Turrentine, Irving L. Kron, and Craig L. Slingluff. 2012. “Research Incentive Program for Clinical Surgical Faculty Associated with Increases in Research Productivity.” The Journal of Thoracic and Cardiovascular Surgery 144(5): 1003–1009. https://doi.org/10.1016/j.jtcvs.2012.07.033.
Stoyanov, Stoyan. 2017. A Theory of Human Motivation. https://doi.org/10.4324/9781912282517.
Sutton, Nicole C. and David A. Brown. 2016. “The Illusion of No Control: Management Control Systems Facilitating Autonomous Motivation in University Research.” Accounting and Finance. https://doi.org/10.1111/acfi.12099.
Towers, Watson. 2012. “Companies That Successfully Retain Top Talent in M&As Start Early, Use Monetary and Nonmonetary Tactics, Towers Watson Survey Finds.” June 2012.
Zainal, Zaidah. 2007. “Case Study as a Research Method Zaidah.” Jurnal Kemanusiaan Bil.9. https://doi.org/10.1177/152342230204300.
Copyright (c) 2021 Muthoni Masinde
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This journal is an open access journal, and the authors and journal should be properly acknowledged, when works are cited.
Authors, copyright holders, may use the publishers version for teaching purposes, in books, theses, dissertations, conferences and conference papers.
A copy of the authors' publishers version may also be hosted on the following websites:
- Non-commercial personal homepage or blog.
- Institutional webpage.
- Authors Institutional Repository.
The following notice should accompany such a posting on the website: This is an electronic version of an article published in SAJHE, Volume XXX, number XXX, pages XXX “XXX", DOI. Authors should also supply a hyperlink to the original paper or indicate where the original paper (http://www.journals.ac.za/index.php/SAJHE) may be found.
Authors publishers version, affiliated with the Stellenbosch University will be automatically deposited in the University Institutional Repository SUNScholar.
Articles as a whole, may not be re-published with another journal.
The following license applies:
Attribution CC BY-NC-ND 4.0