Online tests and technology in language assessment
DOI:
https://doi.org/10.22633/rpge.v29iesp1.20474Keywords:
On-line Assessment, Computer-based Assessment, Computer Adaptive Testing, On-line Alternative Assessment, Artificial IntelligenceAbstract
Technology has an indispensable part of the language learning and teaching process, including assessment. This study investigates technological tools and platforms in on-line language testing and assessment within various aspects. It explores both formative and summative assessments at classroom-based and large-scale tests and also on-line tools having a facilitating effect on alternative assessment. The models, such as Computer-Based Assessment (CBA) and Computer-Adaptive Testing (CAT), are further illustrated. Artificial intelligence, which has a revolutionary effect on language assessment, is scrutinized with the current platforms. Also, critical issues in language assessment, such as reliability and validity issues and basic criticism of on-line language assessment based on authenticity, interactivity, impact, and practicality, are presented with the advantages and disadvantages. Consequently, the study aims to illustrate how language assessment is transformed through technology and offer significant insights for test designers, educators, and policymakers to enhance testing practices.
Downloads
References
Altay, İ. F., & Altay, A. (2017). The impact of on-line reading tasks and reading strategies on EFL learners’ reading test scores. Journal of Language and Linguistic Studies, 13(2), 136-152.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests (Vol. 1). Oxford University Press.
Brown, H. D. (2000). Principles of language learning and teaching (Vol. 4). Longman.
Burstein, J., Frase, L. T., Ginther, A., & Grant, L. (1996). Technologies for language assessment. Annual Review of Applied Linguistics, 16, 240–260. https://doi.org/10.1017/S0267190500001537
Chapelle, C. A., & Douglas, D. (2006). Assessing language through computer technology. Ernst Klett Sprachen.
Chapelle, C. A., & Voss, E. (2008). Utilizing technology in language assessment. In N. H. Hornberger (Ed.), Encyclopedia of language and education, 2(7), 123–134.
Cook, J., & Jenkins, V. (2010). Getting started with e-assessment. University of Bath. http://opus.bath.ac.uk/17712/
Council of Europe. (s.d.). European Language Portfolio (ELP). Retrieved March 10, 2020, from https://www.coe.int/en/web/portfolio
Dunn, L., Morgan, C., O’Reilly, M., & Parry, S. (2005). The student assessment handbook: New directions in traditional and on-line assessment. Routledge.
Educational Testing Service. (s.d.-a). The TOEIC® program. Retrieved April 15, 2020, from https://www.ets.org/toeic/
Educational Testing Service. (s.d.-b). Content and format of the TOEIC® Listening and Reading Test. Retrieved April 15, 2020, from https://www.ets.org/toeic/test-takers/listening-reading/about/content-format/
Educational Testing Service. (s.d.-c). Content and format of the TOEIC® Speaking and Writing Tests. Retrieved April 15, 2020, from https://www.ets.org/toeic/test-takers/speaking-writing/about/content-format/
Educational Testing Service. (s.d.-d). How ETS scores the TOEFL iBT® test. Retrieved April 15, 2020, from https://www.ets.org/s/toefl/flash/33910_toefl-scoring-video_transcript.html
Educational Testing Service. (s.d.-e). About the TOEFL iBT® test. Retrieved April 15, 2020, from https://www.ets.org/toefl/test-takers/ibt/about
Evanini, K., Heilman, M., Wang, X., & Blanchard, D. (2015). Automated scoring for the TOEFL Junior® comprehensive writing and speaking test. ETS Research Report Series, 2015(1), 1–11. https://files.eric.ed.gov/fulltext/EJ1109726.pdf
Fulcher, G., & Davidson, F. (2007). Language testing and assessment. Routledge.
Harmer, J. (2007). The practice of English language teaching (4th ed.). Pearson Education Limited.
Hodgson, P., & Pang, M. Y. C. (2012). Effective formative e-assessment of student learning: A study on a statistics course. Assessment & Evaluation in Higher Education, 37(2), 215–225. https://doi.org/10.1080/02602938.2010.523818
International English Language Testing System (IELTS). (s.d.-a). Computer-delivered IELTS. Retrieved April 15, 2020, from https://www.ielts.org/about-the-test/computer-delivered-ielts
International English Language Testing System (IELTS). (s.d.-b). Test format. Retrieved April 15, 2020, from https://www.ielts.org/about-the-test/test-format
Jamieson, J. (2005). Trends in computer-based second language assessment. Annual Review of Applied Linguistics, 25, 228–242. https://doi.org/10.1017/S0267190505000127
Jiao, H., Liu, J., Haynie, K., Woo, A., & Gorham, J. (2012). Comparison between dichotomous and polytomous scoring of innovative items in a large-scale computerized adaptive test. Educational and Psychological Measurement, 72(3), 493–509. https://doi.org/10.1177/0013164411422903
Jordan, S. E. (2013). E-assessment: Past, present and future. New Directions for Adult and Continuing Education, 2013(140), 87–106. https://doi.org/10.29311/ndtps.v0i9.504
Karani, A. O., & Mwancha, C. N. (2025). The role of ChatGPT in STEM education: Assessing its prospects, challenges, ethical implications, and influence on student creativity and innovation competencies. International Journal of Education, Technology and Science, 5(2), 116–138. https://doi.org/10.5281/zenodo.15489162
Lin, J. W., & Lai, Y. C. (2019). User acceptance model of computer-based assessment: Moderating effect and intention-behavior effect. Australasian Journal of Educational Technology, 35(1), 1–15. https://doi.org/10.14742/ajet.4684
Navrat, P., & Tvarozek, J. (2014). On-line programming exercises for summative assessment in university courses. In Proceedings of the 15th International Conference on Computer Systems and Technologies (pp. 341–348).
Ogrenci Secme ve Yerlestirme Merkezi. (2019). 2019 Yabancı Dil Bilgisi Seviye Tespit Sınavı (YDS) kılavuzu. Retrieved April 15, 2020, from https://dokuman.osym.gov.tr/pdfdokuman/2019/YDS-1/kilavuz30012019.pdf
Oxford University Press. (s.d.-a). Oxford Test of English. Retrieved April 15, 2020, from https://elt.oup.com/feature/global/oxford_test_of_english/?cc=tr&selLanguage=en
Oxford University Press. (s.d.-b). Who recognizes the Oxford Test of English? Retrieved April 15, 2020, from https://elt.oup.com/feature/global/oxford_test_of_english/recognition?cc=tr&selLanguage=en
Pearson. (s.d.-a). PTE Academic. Retrieved April 15, 2020, from https://pearsonpte.com/the-test/
Pearson. (s.d.-b). Test format. Retrieved April 15, 2020, from https://pearsonpte.com/the-test/format/
Pearson. (s.d.-c). How is the test scored? Retrieved April 15, 2020, from https://pearsonpte.com/the-test/about-our-scores/how-is-the-test-scored/
Stannard, R., & Skip Basiel, A. (2013). A practice-based exploration of technology-enhanced assessment for English language teaching. In Motteram, G. (Ed.), Innovations in learning technologies for English language teaching (pp. 145–174). British Council.
Simkin, M. G., & Kuechler, W. L. (2005). Multiple choice tests and student understanding: What is the connection? Decision Sciences Journal of Innovative Education, 3(1), 73–97. https://doi.org/10.1111/j.1540-4609.2005.00053.x
Suvorov, R., & Hegelheimer, V. (2013). Computer‐assisted language testing. In A. J. Kunnan (Ed.), The companion to language assessment (Vol. 2, pp. 594–613). Wiley-Blackwell.
Taras, M. (2005). Assessment–summative and formative–some theoretical reflections. British Journal of Educational Studies, 53(4), 466–478. https://doi.org/10.1111/j.1467-8527.2005.00307.x
Turnitin Feedback Studio. (s.d.-a). What can you do with Feedback Studio? Retrieved March 10, 2020, from https://www.turnitin.com/products/feedback-studio
Turnitin Feedback Studio. (s.d.-b). How to use PeerMark. Retrieved March 10, 2020, from https://www.turnitin.com/videos/how-to-use-peermark
Williamson, H. (2018). On-line exams: The need for best practices and overcoming challenges. The Journal of Public and Professional Sociology, 10(1), 1–7. https://doi.org/10.62915/2154-8935.1128
Xi, X. (2021). Validity and the automated scoring of performance tests. In Fulcher, G. & Harding, L. (Eds.). The Routledge handbook of language testing (2nd ed., pp. 513–529). Routledge.
Xu, J., Galaczi, E., Schmidt, E., & Somers, A. (2025). Automarking in language assessment: Key considerations for best practice. Language Assessment Quarterly.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Revista on line de Política e Gestão Educacional

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Manuscritos aceitos e publicados são de propriedade da Revista on line de Política e Gestão Educacional. É vedada a submissão integral ou parcial do manuscrito a qualquer outro periódico. A responsabilidade do conteúdo dos artigos é exclusiva dos autores. É vedada a tradução para outro idioma sem a autorização escrita do Editor ouvida a Comissão Editorial Científica.


