Institutional responses to academic literacy challenges: An in-house test as an alternative for assessing academic literacy levels
Abstract
The COVID-19 pandemic brought about disruptions to the administration of conventional academic literacy tests, which necessitated alternative ways of identifying students in need of literacy support. In response to this disruption, an existing in-house test was identified as a potential alternative for measuring incoming students’ ability to handle the demands of academic discourse. Such an alternative was necessary for the effective identification of students needing additional academic literacy support and their placement in appropriate faculty-specific literacy courses. Although the first round of institutional piloting deemed the online version of the test appropriate for being employed for these purposes, a further administration of the test was conducted to confirm whether the traditional (pencil-and-paper) version of the test yielded similar results and whether the quality of the test is such that it is appropriate for implementation at an institutional level. This paper compares the results of these two administrations of the test and reflects on the potential value of such an in-house test to achieve and enhance the synchrony between assessment, curriculum and teaching, building on earlier work on this.
Downloads
References
Bond, B. (2020). Making language visible in the university: English for academic purposes and internationalisation. Multilingual Matters.
Boughey, C. (2013). What are we thinking of? A critical overview of approaches to developing academic literacy in South African higher education. Journal for Language Teaching 47(2), 24–42. https://hdl.handle.net/10520/EJC148781
CITO. (2005). TiaPlus user’s manual. M & R Department.
Clarence, S. (2011). Writing in the academy. In A. Archer, & R. Richards (Eds.), Changing spaces: Writing centres and access to higher education, Sun Press.
Dison, L., & Moore, J. (2019). Creating conditions for working collaboratively in discipline-based writing centres at a South African university. Per Linguam 35(1), 1–14. https://doi.org/10.5785/35-1-851
Drennan, L. (2019). Defensibility and accountability: Developing a theoretically justifiable academic writing intervention for students at tertiary level [Doctoral thesis, University of the Free State]. KovsieScholar Repository. https://hdl.handle.net/11660/10888
Drennan, L. (2021). Assessing readiness to write: The design of an Assessment of Preparedness to Present Multimodal Information (APPMI). In A. Weideman, J. Read, & T. du Plessis, (Eds.), Assessing academic literacy in a multilingual society: Transition and transformation (pp. 196–216). Multilingual Matters.
Drennan, L., Joubert, M., Weideman, A., & Posthumus, R. (2021). Combined measures of identifying language risk for first-year students. Journal of Language Teaching 55(2), 93-116. https://doi.org/10.4314/jlt.v55i2.4
Frederiksen, C. H. (1975). Representing logical and semantic structure of knowledge acquired from discourse. Cognitive Psychology 7, 317–458. https://doi.org/10.1016/0010-0285(75)90016-X
Jacobs, C. (2005). On being an insider on the outside: New spaces for integrating academic literacies. Teaching in Higher Education 10(4), 475–487. https://doi.org/10.1080/13562510500239091
Jacobs, C. (2007a). Towards a critical understanding of the teaching of discipline-specific academic literacies: Making the tacit explicit. Journal of Education 41, 59–81. https://hdl.handle.net/10520/AJA0259479X_23
Jacobs, C. (2007b). Mainstreaming academic literacy teaching: implications for how academic development understands its work in higher education. South African Journal of Higher Education 21(7), 870–881. https://hdl.handle.net/10520/EJC37399
Jacobs, C. (2010). Collaboration as pedagogy: consequences and implications for partnerships between communication and disciplinary specialists. Southern African Linguistics and Applied Language Studies 28(3), 227–237. https://doi.org/10.2989/16073614.2010.
Joubert, M., Larsen, A., Magnuson, B., Waldron, D., Sabo, E., & Fletcher, A. (2023). Global challenges: South African and Australian students’ experiences of emergency remote teaching. Journal for University Teaching & Learning Practice 20(4). https://doi.org/10.53761/1.20.4.09
Mcnamara, T., Knoch, U., & Fan, J. (2019). Fairness, justice and language assessment: The role of measurement. Oxford University Press.
Mihindou, G. R. (2019). Language and academic literacies development at the University of Johannesburg. In C. L. Scott, & E. N. Ivala (Eds.), Transformation of higher education institutions in post-apartheid South Africa. Routledge.
Network of Expertise in Language Assessment (NExLA). (2023). Bibliography. https://nexla.org.za/research-on-language-assessment/
Patterson, R., & Weideman, A. (2013a). The typicality of academic discourse and its relevance for constructs of academic literacy. Journal for Language Teaching 47(1), 107-123. https://doi.org/10.4314/jlt.v47i1.5
Patterson, R., & Weideman, A. (2013b). The refinement of a construct for tests of academic literacy. Journal for Language Teaching 47(1), 125–151. https://doi.org/10.4314/jlt.v47i1.6
Sebolai, K. (2022a). Determining the faculty specific academic literacies needs of first year university students: A mixed methods approach. Journal for Language Teaching 56(2), 1-20. https://doi.org/10.56285/jltVol56iss2a5702
Sebolai, K. (2022b). The Academic Development approach to academic literacy in higher education South Africa: A disconnect between teaching and assessment. Journal for Language Teaching, 56(2), 1–16. https://doi.org/10.56285/jltVol56iss2a5387
Sebolai, K., & Stanford, F. (2020). Validating the highest performance standard of a test of academic literacy at a South African University. Per Linguam, 36(2), 76–89. https://hdl.handle.net/10520/ejc-perling-v36-n2-a7
Spivey, N. N. (2001). Discourse synthesis: Process and product. In R. G. McInnis (Ed.), Discourse synthesis: Studies in historical and contemporary social epistemology (pp. 379–396). Praeger.
Spivey, N. N., & King, J. R. (1989). Readers as writers composing from sources. Reading Research Quarterly, 24, 7–26. https://www.jstor.org/stable/748008
Van Dijk, T. A. (1979). Relevance assignment in discourse comprehension. Discourse Processes 2, 113–126. https://doi.org/10.1080/01638537909544458
Van Dyk, T. (2021). Postscript: What the data tell us: An overview of language assessment research in South Africa’s multilingual context. In A.Weideman, J. Read,. & T. du Plessis (Eds.), Assessing academic literacy in a multilingual society: Transition and transformation (pp. 217–235). Multilingual Matters.
Weideman, A. (2003). Assessing and developing academic literacy. Per Linguam 19(1 & 2), 55–65. https://doi.org/10.5785/19-1-89
Weideman, A. (2017). Responsible design in applied linguistics: Theory and practice. Springer. https://doi.org/10.1007/978-3-319-41731-8
Weideman, A. (2019). Definition and design: Aligning language interventions in education. Stellenbosch Papers in Linguistics (SPIL) Plus), 56(1), 31–46. https://doi.org/10.5842/56-0-782
Weideman, A. (2020). Complementary evidence in the early-stage validation of language tests: Classical Test Theory and Rasch analyses. Per Linguam. 36(2), 57–75. https://hdl.handle.net/10520/ejc-perling-v36-n2-a6
Weideman, A. (2024). A theory of applied linguistics: Imagining and disclosing the meaning of design. Springer. https://doi.org/10.1007/978-3-031-67559-1
Wingate, U. (2015). Academic literacy and student diversity:Tthe case for inclusive practice, Multilingual Matters, Bristol.
Copyright (c) 2024 Laura Maria Drennan, Michelle Joubert, Albert Weideman
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.