Exploring the alignment of first-year summative assessments with Bloom’s Taxonomy: A longitudinal study
Abstract
The correlation between the level of difficulty of assessments, Bloom’s Taxonomy as well as pass rates of courses has been a seriously under-researched area in South Africa. In this study, we proposed the revised Bloom’s taxonomy level of difficulty index, before we examined 112 first-year 2017‒2019 final and supplementary assessment papers from the Economic and Management Sciences Faculty of a university in Western Cape.
The descriptive statistics showed that these assessment papers are different in terms of duration, total marks, type of questions asked as well as pass rates. It was also found that these first-year summative assessments asked questions mainly at levels two (understand) and three (apply) of the revised Bloom’s Taxonomy. In addition, the correlation and econometric analysis did not find a strong correlation between the level of difficulty index and pass rates. Nonetheless, the above-mentioned results need to be interpreted with great caution, because strictly speaking, one should also control for differences in other characteristics (e.g., students’ personal characteristics, school characteristics and lecture attendance).
To conclude, there is no explicit national policy that guides higher education institutions (HEIs) on how to use Bloom’s or any other taxonomy to assess students at the appropriate National Qualifications Framework (NQF) level. Hence, our findings suggest that there is a need for a national assessment policy framework to guide HEIs on how to assess undergraduate students at different cognitive levels as required by the NQF.
References
Anderson, L. W., D. R. Krathwohl, P. W. Airasian, K. A. Cruikshank, R. E. Mayer, P. R. Pintrich, J. Raths, and M. C. Wittrock. 2001. A taxonomy for learning, teaching and assessing: A revision of Bloom’s Taxonomy of educational objectives. Abridged edition. New York: Longman.
Forehand, M. 2005. “Bloom’s taxonomy: Original and revised.” In Emerging perspectives on learning, teaching, and technology, ed. M. Oredy. http://projects.coe.uga.edu/epltt/. (Accessed 20 July 2020).
Jabbar, D. A. and Z. Omar. 2015. “Exam question classifications based on Bloom’s taxonomy cognitive level using classifiers combination.” Journal of Theoretical and Applied Information Technology 78(3): 1‒21.
Kembo, J. 2020. “How effectively are university students tested? A case study.” Eastern African Journal of Education Studies 2(1): 59‒66.
Krathwohl, D. R. 2002. “A Revision of Bloom’s taxonomy: an overview.” Theory Into Practice 41(4): 212‒218.
Mawa, B., M. M. Haque, and M. M. Ali. 2019. “Level of learning assessed through written examinations in social science courses in tertiary education: A study from Bangladesh.” Journal of Teacher Education and Research 14(1): 7‒12.
Omar, Z., S. F. Syahidah, R. Hassan, H. Arshad, M. Rahmat, N. F. A. Zainal, and R. Zulkifli. 2012. “Automated analysis of exam questions according to Bloom’s Taxonomy.” Procedia – Social and Behavioural Sciences 59(1): 297‒303.
Ontong, J. M. and A. Bruwer. 2020. “The use of past assessments as a deductive learning tool? Perceptions of students at a South African University.” South African Journal of Higher Education 34(2): 177‒190.
SAQA see South African Qualifications Authority.
Smith, G., L. Wood, M. Coupland, and B. Stephen. 1996. “Constructing mathematical examination to assess a range of knowledge and skills.” International Journal of Mathematical Education in Science and Technology 21(1): 65–77.
South African Qualifications Authority. 2012. Level descriptors for the South African National Qualifications Framework. Pretoria: SAQA.
Tremblay, K., D. Lalancette, and D. Roseveare. 2012. Assessment of higher education learning outcomes. Feasibility study report. Volume 1: Design and implementation. Paris: Organisation for Economic Co-operation and Development (OECD).
University of the Western Cape. 2019. “UWC Student Success and Retention Framework.” Unpublished study. Bellville: University of the Western Cape.
University of the Western Cape. 2020. UWC examination paper repository. (Accessed 15 July 2020).
University of the Western Cape. 2021. UWC 2021 General Calendar. Bellville: University of the Western Cape.
UWC see University of the Western Cape.
Weir, C. and J. Roberts. 1994. Evaluation in ELT. Oxford: Blackwell.
Copyright (c) 2021 Karen dos Reis, Christie Swanepoel, Derek Yu, Fiona Anciano
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This journal is an open access journal, and the authors and journal should be properly acknowledged, when works are cited.
Authors, copyright holders, may use the publishers version for teaching purposes, in books, theses, dissertations, conferences and conference papers.
A copy of the authors' publishers version may also be hosted on the following websites:
- Non-commercial personal homepage or blog.
- Institutional webpage.
- Authors Institutional Repository.
The following notice should accompany such a posting on the website: This is an electronic version of an article published in SAJHE, Volume XXX, number XXX, pages XXX “XXX", DOI. Authors should also supply a hyperlink to the original paper or indicate where the original paper (http://www.journals.ac.za/index.php/SAJHE) may be found.
Authors publishers version, affiliated with the Stellenbosch University will be automatically deposited in the University Institutional Repository SUNScholar.
Articles as a whole, may not be re-published with another journal.
The following license applies:
Attribution CC BY-NC-ND 4.0
