Accountancy students’ and lecturers’ perceptions of the effect of open-book assessments on writing examinations
Abstract
Open-book assessment (OBA) can contribute to the development of competency in handling large amounts of information in the knowledge economy. This is one of the reasons why the South African Institute of Chartered Accountants (SAICA) implemented OBA for its Initial Test of Competence. This empirical study investigated final year accountancy students’ and lecturers’ perceptions of the effect on writing examinations after their method of assessment changed from a closed-book (CBA) to an open-book assessment format.
Students and lecturers perceived a change in writing behaviour, reduced anxiety, and improved performance. On some aspects the level of agreement between students and lecturers differed significantly. There is also evidence that African students perceived OBA to be less beneficial compared to the perceptions of white students. For subjects for which substantial texts were available, students perceived the least change happened for Auditing while lecturers perceived the least change for Financial Accounting. Both students and lecturers perceived the most change happened for Taxation. It is important that lecturers at departments of accountancy take cognisance of these perception gaps and to adjust their teaching to enable their students to utilise their texts as an additional resource optimally. This study is also of value to the regulatory bodies to evaluate their assessment practises.
References
Agarwal, P.K. & Roediger, H.L. (2011). ‘Expectancy of an open-book test decreases performance on a delayed closed-book test.’ Memory 19(8): 836–852.
Amanullah, M., Zaman, G.S., Patel, A.A. & Mohanna, K. (2013). ‘A comparative study of Open Book-Open Web ( OBOW ) exams and Invigilated Closed Book-Pen and Paper (ICBPP ) exams.’ Merit Research Journal of Education and Review 1(4): 97–106.
Block, R.M. (2012). ‘A discussion of the effect of open-book and closed-book exams on student achievement in an introductory statistics course.’ PRIMUS: Problems, Resources, and Issues in Mathematics Undergraduate Studies 22(3):228–238.
Broyles, I.L., Cyr, P.R. & Korsen, N. (2005). ‘Open-book tests: Assessment of academic learning in clerkships.’ Medical Teacher 27(5):456–462.
Carless, D. (2006). ‘Differing perceptions in the feedback process.’ Studies in Higher Education 31(2):219–233.
Cross, M. & Carpentier, C. (2009). ‘“New Students” In South African Higher Education: Institutional Culture, Student Performance and the Challenge of Democratisation.’ Perspectives in Education. 27(1 March):6–18.
Dull, R.B., Schleifer, L.L.F. & McMillan, J.J. (2015). ‘Achievement goal theory: The relationship of accounting students’ goal orientations with self-efficacy, anxiety, and achievement.’ Accounting Education 24(2):152–174.
Durning, S.J., Dong, T., Ratcliffe, T., Schuwirth, L., Artino, A.R., Boulet, J.R. & Eva, K. (2016). ‘Comparing Open-Book and Closed-Book Examinations. Academic Medicine’ 91(4):583–599.
Du Preez, H. (2015). ‘Taxation students’ perceptions of open-book assessment: A follow-up interactive qualitative analysis.’ South African Journal of Accounting Research 29(1):84–99.
Du Preez, H. & Du Preez, C. (2012). ‘Taxation students’ perceptions of open-book assessment prior to the qualifying examination of South African chartered accountants.’ South African Journal of Accounting Research 26(1):119–142.
Eilertsen, T.V. & Valdermo, O. (2000). ‘Open-book assessment: A contribution to improved learning?’ Studies in Educational Evaluation 26(2):91–103.
Fraser, W.J. & Killen, R. (2003). ‘Factors influencing academic success or failure of first-year and senior university students: do education students and lecturers perceive things differently?’ South African Journal of Education. 23(4):254–263.
Gharib, A. & Phillips, W. (2013). ‘Test anxiety, student preferences and performance on different exam types in introductory psychology.’ International Journal of e-Education, e-Business, e-Management and e-Learning 3(1):1-6.
Green, S.G., Ferrante, C.J. & Heppard, K.A. (2016). ‘Using open-book exams to enhance student learning, performance, and motivation.’ The Journal of Effective Teaching 16(1):19–35.
Heijne-Penninga, M. (2010). ‘Open-book tests assessed: Quality, learning behaviour, test time and performance.’ Unpublished Phd thesis. Groningen : University of Groningen
Heijne-Penninga, M., Kuks, J.B.M., Hofman, W.H.A. & Cohen-Schotanus, J. (2008). ‘Influence of open- and closed-book tests on medical students’ learning approaches.’ Medical Education 42(10):967–974.
Heijne-Penninga, M., Kuks, J.B.M., Hofman, W.H.A. & Cohen-Schotanus, J. (2011). ‘Directing students to profound open-book test preparation: The relationship between deep learning and open-book test time.’ Medical Teacher 33(1):e16–e21.
Karagiannopoulou, E. & Milienos, F.S. (2013). ‘Exploring the relationship between experienced students’ preference for open- and closed-book examinations, approaches to learning and achievement.’ Educational Research and Evaluation 19(4):271–296.
Koutselini, M. (1997). ‘Testing and life-long learning: Open-book and closed-book examination in a university course.’ Studies in Educational Evaluation 23(2):131–139.
Larwin, K.H., Gorman, J. & Larwin, D.A. (2013). ‘Assessing the impact of testing aids on post-secondary student performance: A meta-analytic investigation.’ Educational Psychology Review 25(3):429–443.
McConnell, M.M. & Eva, K.W. (2012). ‘The Role of Emotion in the Learning and Transfer of Clinical Skills and Knowledge.’ Academic Medicine 87(10):1316–1322.
Mathew, N. (2012). ‘Student Preferences and Performance: A Comparison of Open-Book, Closed Book, and Cheat Sheet Exam Types.’ Proceedings of the National Conference on Undergraduate Research 29-31 March, Ogden, Utah.
Mulliner, E. & Tucker, M. (2017). ‘Feedback on feedback practice: perceptions of students and academics.’ Assessment & Evaluation in Higher Education 42(2):266-288.
Mungal, A., & Cloete, M. (2017). ‘Preparing underprepared students for higher education and beyond: The development and implementation of an integrated project.’ Accounting Education, 25(3), 203–222.
Rakes, G.C. (2008). ‘Open-book testing in online learning environments. Journal of Interactive Online Learning 7(1):1–9.
Rowlands, J.E. & Forsyth, D. (2006). ‘Open-book professional accountancy examinations.’ South African Journal of Higher Education 20(5):703–717.
Rust, C. (2002). ‘The impact of assessment on student learning.’ Active Learning in Higher Education 3(2):145–158.
Rust, C. (2007). ‘Towards a scholarship of assessment.’ Assessment & Evaluation in Higher Education 32(2):229–237.
Shine, S., Kiravu, C. & Astley, J. (2004). ‘In defence of open-book engineering degree examinations.’ International Journal of Mechanical Engineering Education 32(3):197–211.
Stainbank, L.J. (2010). ‘Students’ perceptions of the usefulness of an accounting project in acquiring accounting knowledge and professional skills.’ Meditari Accountancy Research, 24(1):79–100.
Steenkamp, G. (2012). ‘The impact of study behaviour on the success of South African CTA students.’ SA Journal of Accounting Research 26(1):1–15.
Steenkamp, L.P., Baard, R.S. & Frick, B.L. (2009). ‘Factors influencing success in first-year accounting at a South African university: A comparison between lecturers’ assumptions and students’ perceptions.’ SA Journal of Accounting Research 23(1):113–140.
Stout, D.E. & Wygal, D.E. (2010). ‘Negative behaviors that impede learning: Survey findings from award-winning accounting educators.’ Journal of Accounting Education 28(2):58–74.
Watty, K., Jackson, M. & Yu, X. (2010). ‘Students’ approaches to assessment in accounting education: The unique student perspective.’ Accounting Education, 19(3):219–234.
Westerkamp, A.C., Heijne-Penninga, M., Kuks, J.B.M. & Cohen-Schotanus, J. (2013). ‘Open-book tests: Search behaviour, time used and test scores. Medical Teacher 35(4):330–332.
This journal is an open access journal, and the authors and journal should be properly acknowledged, when works are cited.
Authors, copyright holders, may use the publishers version for teaching purposes, in books, theses, dissertations, conferences and conference papers.
A copy of the authors' publishers version may also be hosted on the following websites:
- Non-commercial personal homepage or blog.
- Institutional webpage.
- Authors Institutional Repository.
The following notice should accompany such a posting on the website: This is an electronic version of an article published in SAJHE, Volume XXX, number XXX, pages XXX “XXX", DOI. Authors should also supply a hyperlink to the original paper or indicate where the original paper (http://www.journals.ac.za/index.php/SAJHE) may be found.
Authors publishers version, affiliated with the Stellenbosch University will be automatically deposited in the University Institutional Repository SUNScholar.
Articles as a whole, may not be re-published with another journal.
The following license applies:
Attribution CC BY-NC-ND 4.0
