The development, validation and standardisation of a questionnaire measuring an Auditing teaching-learning intervention at a SAICA-accredited university
Abstract
Questionnaires are widely used in the Accountancy field as a data collection instrument. However, previous studies have contentious views on the reliability of questionnaires in academic studies. This study describes the development of a custom-made questionnaire to evaluate the effectiveness of a teaching-learning intervention, the Audit Cube, designed to affect the knowledge, skills, attitudes and values of Auditing of B.Com. honours students in the Accountancy field at a SAICA-accredited university. The questionnaire was distributed to 156 university honours students, whereafter it was validated and standardised. Most of the extracted factors indicated a reliability level higher than 0.9, signifying that the constructs were suitable to address the project’s research question and that the questionnaire is valid. In conclusion, this study found that the use of questionnaires in academic studies is deemed reliable if a standardised process is followed in its development. Consequently, the study suggests that custom-made questionnaires should undergo factor analysis to prove the instrument’s validity prior to reporting on the findings. The findings of this study may be useful to academics in providing guidelines in developing their own data collection instrument to measure the effectiveness of a teaching-learning intervention and may also support the use of questionnaires by researchers in the teaching-learning environment.
References
Ambrose, S. A., M. W. Bridges, M. DiPietro, M. C. Lovett, and M. K. Norman. 2010. How learning works: Seven research-based principles for smart teaching. John Wiley & Sons.
Babbie, E. 2007. The practice of social research. 11th Edition. Belmont: Thomson Wadsworth.
Babbie, E. R. 2016. The practice of social research. 14th Edition. Boston, USA: Cengage Learning.
Barkley, E. F. 2010. Student engagement techniques: A handbook for college faculty. San Francisco: Jossey-Bass.
Breckler, S. J. 1984. “Empirical validation of affect, behavior, and cognition as distinct components of attitude.” Journal of Personality and Social Psychology 47(6): 1191‒1205.
Burrell, G. and G. Morgan. 1979. Sociological paradigms and organisational analysis. Brookfield, VT: Ashgate.
Carrasco, J. and K. Lucas. 2015. “Workshop synthesis: Measuring attitudes; quantitative and qualitative methods.” Transportation Research Procedia 11: 165‒171.
Cohen, L., L. Manion, and K. Morrison. 2011. Research methods in education. 7th Edition. London: Routledge.
Cohen, L., L. Manion, and K. Morrison. 2017. Research methods in education. 8th Edition. Routledge.
Converse, P. D., E. W. Wolfe, X. Huang, and F. L. Oswald. 2008. “Response rates for mixed-mode surveys using mail and e-mail/web.” American Journal of Evaluation 29(1): 99‒107.
Creswell, J. W. and J. D. Creswell. 2018. Research design: Qualitative, quantitative and mixed methods approaches. 5th Edition. California: SAGE Edge.
Creswell, J.W., L. Ebersohn, I. Eloff, R. Ferreira, N. V. Ivankova, J. D. Jansen, J. Nieuwenhuis, et al. 2010. First steps in research. 4th Edition. Pretoria: Van Schaik Publishers.
Creswell, J. W. and V. L. Plano Clark. 2007. Designing and conducting mixed methods research. California: SAGE Publications Ltd.
De Villiers, R. 2010. “The incorporation of soft skills into accounting curricula: preparing accounting graduates for their unpredictable futures.” Meditari: Research Journal of the School of Accounting Sciences 18(2): 1‒22.
De Villiers, R. R. 2015. “Evaluating the effectiveness of a newly developed simulation in audit education.” North-West University Potchefstroom, South Africa.
De Vos, A. S., H. Strydom, C. B. Fouché, and C. S. L. Delport. 2018. Research at grass roots: For the social science and human services profession. 4th Edition. Pretoria: Van Schaik Publishers.
Dey, E. L. 1997. “Working with low survey response rates: The efficacy of weighting adjustments.” Research in Higher Education 38(2): 215‒227.
Durrheim, K. 2006. “Research design.” In Research in practice: Applied methods for social sciences, ed. M. Terre Blanche, K. Durrheim, and D. Painter, 33‒59. Cape Town: UCT.
Ebert, J. F., L. Huibers, B. Christensen, and M. B. Christensen. 2018. “Or web-based questionnaire invitations as a method for data collection: Cross-sectional comparative study of differences in response rate, completeness of data, and financial cost.” Journal of Medical Internet Research 20(1): 1‒13.
Elliot, A. J. and M. A. Maier. 2014. “Color psychology: Effects of perceiving color on psychological functioning in humans.” Annual Review of Psychology 65: 95‒120.
Fan, W. and Z. Yan. 2010. “Factors affecting response rates of the web survey: A systematic review.” Computers in Human Behavior 26(2): 132‒139.
Grigoryan, L. and S. H. Schwartz. 2021. “Values and attitudes towards cultural diversity: Exploring alternative moderators of the value–attitude link.” Group Processes & Intergroup Relations 24(6): 966‒981.
Grinnell, R. M. and Y. A. Unrau. 2008. Social work research and evaluation: Foundations of evidence-based practice. New York: Oxford University Press.
Grover, R. and M. Vriens. 2006. The handbook of marketing research: Uses, misuses, and future advances. United Kingdom: SAGE Publications Inc.
Husser, J. A. and K. E. Fernandez. 2013. “To click, type, or drag? Evaluating speed of survey data input methods.” Survey Practice 6(2): 1‒7.
IFAC. 2019. SAICA Student Handbook 2019/2020. South Africa: LexisNexis.
Ivankova, N. V., J. W. Creswell, and V. L. Plano Clark. 2007. “Foundations and approaches to mixed methods research.” In First steps in research, ed. K. Maree. Pretoria: Van Schaik.
Kumar, R. 2019. Research methodology. 5th Edition. United Kingdom: SAGE Publications.
Lamprecht, J. 2011. “The effective management of resource material in open-book assessment by accounting honnours students in Auditing.” Mini-dissertation, University of the Free State, Bloemfontein.
Lamprecht, J. 2017. Audit Cube. South Africa.
Leedy, P. D. and J. E. Ormrod. 2010. Practical research. 9th Edition. Upper Saddle River: Merrill.
Leendertz, V., A. S. Blignaut, S. Ellis, and H. D. Nieuwoud. 2015. “The development, validation and standardisation of a questionnaire for ICT professional development of mathematics teachers.” pythagoras 36(2): 1‒11.
Mack, L. 2010. “The philosophical underpinnings of educational research.” Polyglossia 19: 1‒7.
Mahmoud, H. G., K. E. Ahmed, and E. A. Ibrahim. 2019. “Learning styles and learning approaches of bachelor nursing students and its relation to their achievement.” International Journal of Nursing Didactics 9(03): 11‒20.
Maree, K. and J. Pietersen. 2007. The quantitative research process. Pretoria: Van Schaik.
Mazana, M. Y., C. S. Montero, and R. O. Casmir. 2019. “Investigating students’ attitude towards learning mathematics.” International Electronic Journal of Mathematics Education 14(1): 207‒231.
McMillan, J. H. and S. Schumacher. 2001. Research in education: A conceptual introduction. 5th Edition. New York: Addison Wesley Longman.
Mentz, M. 2014. “An integrated audit evidence planning model to quantify the extent of audit evidence.” Doctor’s thesis, University of South Africa, Pretoria. http://hdl.handle.net/10500/18477.
Merriam, S. B. 2009. Qualitative research: A guide to design and implementation. 2nd Edition. San Francisco: Jossey-Bass.
Mertens, D. M. 2004. Research and evaluation in education and psychology: Integrating diversity with quantitative, qualitative, and mixed methods. 4th Edition. Thousand Oaks: SAGE Publications Ltd.
Modisane, T. C. 2019. “Establishing a competency framework for the integration of workplace Information Technology knowledge and skills within an Internal Audit education programme and training.” North-West University (South Africa). Vanderbijlpark Campus.
Monette, D. R., T. J. Sullivan, and D. R. DeJong. 2002. Applied social research: Tool for the human services. 5th Edition. Orlando: Harcourt College.
Mouton, J. 2001. How to succeed in your Master’s and Doctoral studies. A South African guide and resource book. Pretoria: Van Schaik Publishers.
Mouton, J. 2011. How to succeed in your master’s and doctoral studies: A South African guide and resource book. 11th Edition. Pretoria: Van Schaik.
Neuman, W. L. 2006. Social research methods: Qualitative and quantitative approaches. 6th Edition. Boston: Pearson Education Inc.
Neuman, W. L. 2011. Social research methods: Qualitative and quantitative approaches. 7th Edition. Boston: Pearson Education Inc.
Nudelman, C. 2015. “Language in South Africa’s higher education transformation: A study of language policies at four universities.” University of Cape Town.
OECD see Organisation for Economic Co-operation and Development.
Organisation for Economic Co-operation and Development. 2019. “OECD future of education and skills 2030 Concept Note.” https://www.oecd.org/education/2030-project/teaching-and-learning/learning/attitudes-and-values/Attitudes_and_Values_for_2030_concept_note.pdf. (Accessed 17 November 2021).
Patton, M. Q. 2002. Qualitative research and evaluation methods. Thousand Oaks. 3rd Edition. California: SAGE Publications Ltd.
Pérez-Jorge, D., F. B. Medero, and E. Molina-Fernández. 2017. “A study of educational programmes that promote attitude change and values education in Spain.” Asian Social Science 13(7): 112‒130.
Pradhan, K. 1999. “The internet in Nepal: A survey report.” The International Information & Library Review 31(1): 41‒47.
Rattray, J. R. and M. C. Jones. 2007. “Essential elements of questionnaire design and development.” Journal of Clinical Nursing 16(2): 234‒243.
Romney, M. B., J. O. Cherrington, and E. L. Denna. 1996. “Using information systems as a basis for teaching accounting.” Journal of Accounting Education 14(1): 57‒67. https://doi.org/10.1016/0748-5751(95)00030-5.
Saleh, A. and K. Bista. 2017. “Examining factors impacting online survey response rates in educational research: Perceptions of graduate students.” Online Submission 13(2): 63‒74.
Salkind, N. J. 2006. Exploring research. 6th Edition. New Jersey: Pearson Education.
Sills, S. J. and C. Song. 2002. “Innovations in survey research: An application of web-based surveys.” Social Science Computer Review 20(1): 22‒30.
Stoker, D. J. 1985. Sampling: Personal communication to the author. Pretoria: Human Sciences Research Council.
Stumke, O. 2014. “Bridging the expectation gap of IT competencies between accountancy trainees, SAICA and employers.” Dissertation, North-West University.
Swart, J. J. 2013. “Audit materiality and risk: Benchmarks and the impact on the audit process.” Dissertation, North-West University.
Swart, J. J. 2018. “Audit methodologies: Developing an integrated planning model incorporating audit materiality, risk and sampling.” PhD. North-West University.
Tapia, M. and G. E. Marsh. 2004. “An instrument to measure mathematics attitudes.” Academic Exchange Quarterly 8(2): 16‒22.
Tedesco, J. C., R. Opertti, and M. Amadio. 2014. “The curriculum debate: Why it is important today.” Prospects 44: 527‒546.
Theuri, P. M. and R. Gunn. 1998. “Accounting information systems course structure and employer systems skills expectations.” Journal of Accounting Education 16(1): 101‒121. https://doi.org/10.1016/S0748-5751(98)00005-0.
Vaishnav, R. S. and K. Chirayu. 2013. “Learning style and academic achievement of secondary school students.” Voice of Research 1(4): 1‒4.
Valdez, P. and A. Mehrabian. 1994. “Effects of color on emotions.” Journal of Experimental Psychology: General 123(4): 394.
Wally-Dima, L. 2011. “Bridging the gap between accounting education and accounting practice: The case of the University of Botswana.” IUP Journal of Accounting Research & Audit Practices 10(4): 7.
Welman, C., F. Kruger, and B. Mitchell. 2005. Research methodology. 3rd Edition. Cape Town: Oxford University Press.
Yates, S. J. 2004. Doing social science research. London: SAGE Publications Ltd.
Copyright (c) 2022 Olive Stumke, Anneke Maré Moolman, Verona Leendertz
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
This journal is an open access journal, and the authors and journal should be properly acknowledged, when works are cited.
Authors, copyright holders, may use the publishers version for teaching purposes, in books, theses, dissertations, conferences and conference papers.
A copy of the authors' publishers version may also be hosted on the following websites:
- Non-commercial personal homepage or blog.
- Institutional webpage.
- Authors Institutional Repository.
The following notice should accompany such a posting on the website: This is an electronic version of an article published in SAJHE, Volume XXX, number XXX, pages XXX “XXX", DOI. Authors should also supply a hyperlink to the original paper or indicate where the original paper (http://www.journals.ac.za/index.php/SAJHE) may be found.
Authors publishers version, affiliated with the Stellenbosch University will be automatically deposited in the University Institutional Repository SUNScholar.
Articles as a whole, may not be re-published with another journal.
The following license applies:
Attribution CC BY-NC-ND 4.0
