TRENDS IN ARTIFICIAL INTELLIGENCE-INFUSED ENGLISH LANGUAGE LEARNING: A COMPREHENSIVE BIBLIOMETRIC AND CONTENT REVIEW

Authors

DOI:

https://doi.org/10.20535/2410-8286.315035

Keywords:

AI-driven language instruction, English foreign language learning, Knowledge mapping, Literature review, Pedagogical strategies

Abstract

Notwithstanding the increase in research on artificial intelligence-infused English language learning, several issues remain inadequately addressed. Thus, this paper provides a systematic review and analyzes previous studies to pinpoint fruitful knowledge gaps and outline approaches for future research directions. Two approaches, bibliometric and descriptive content analysis, were employed in this study. Firstly, we extracted data for bibliometric analysis from the Scopus database, covering publications from 1996 to 2024. The findings show that the topic peaked in 2024, with 107 articles published. China was the most cited country, with 1.215 citations, and the most productive country, with 327 articles. The International Journal of Emerging Technologies in Learning published the majority of the articles. The research theme evolved to emphasize English learning and student involvement through mobile learning. We applied descriptive content analysis to selected papers published between 2014 and 2024. Theoretically, the findings suggest that addressing knowledge gaps can enhance the integration of artificial intelligence in English language learning. Empirically, the mixed studies used descriptive statistics collected through observation and questionnaires, with a medium sample size selected through random sampling, a commonly used research design. These approaches can potentially expand the scholarly literature on this subject.

 

Downloads

Download data is not yet available.

Author Biographies

Sri Wahyuni, Universitas Negeri Yogyakarta

Sri Wahyuni is a doctoral student in the Language Education Science Department, Faculty of Languages, Arts, and Culture, Universitas Negeri Yogyakarta. She has been awarded the Indonesia Education Scholarship (BPI) in collaboration with the Ministry of Education, Culture, Research, and Technology (Kemendikbudristek) and the Indonesia Endowment Funds for Education (LPDP). She currently teaches at the Universitas Islam Riau, Pekanbaru, Indonesia. She consistently dedicated her work to technology-enhanced English language learning, particularly in English academic writing.

Nur Hidayanto Pancoro Setyo Putro, Universitas Negeri Yogyakarta

Nur Hidayanto Pancoro Setyo Putro is a professor at Universitas Negeri Yogyakarta, Indonesia, in the field of English language teaching. He teaches in the English Language Education Study Program at Universitas Negeri Yogyakarta. Areas of interest include digital reading, writing in professional contexts, evaluation of language teaching, and speaking in professional contexts.

Anwar Efendi, Universitas Negeri Yogyakarta

Anwar Efendi is a professor of modern Indonesian literature in the Language Education Science Department, Faculty of Languages, Arts, and Culture, Universitas Negeri Yogyakarta. His research interests are literature and religiosity (prophetic), comparative literature, and literary learning.

References

  1. Akhmadieva, R. S., Udina, N. N., Kosheleva, Y. P., Zhdanov, S. P., Timofeeva, M. O., & Budkevich, R. L. (2023). Artificial intelligence in science education: A bibliometric review. Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13587
  2. Al-khresheh, M. H. (2024). The future of artificial intelligence in English language teaching: Pros and cons of ChatGPT implementation through a systematic review. Language Teaching Research Quarterly, 43, 54–80. https://doi.org/10.32038/ltrq.2024.43.04
  3. Algaraady, J., & Mahyoob, M. (2023). ChatGPT’s capabilities in spotting and analyzing writing errors experienced by EFL learners. Arab World English Journal, Special Is(9), 3–17. https://doi.org/10.24093/awej/call9.1
  4. Aria, M., & Cuccurullo, C. (2017). bibliometrix : An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/j.joi.2017.08.007
  5. Arif Husein Lubis, Didin Samsudin, Risa Triarisanti, Mohammad Iqbal Jerusalem, & Yoonjung Hwang. (2024). A bibliometric mapping analysis of publications on the utilization of artificial intelligence technology in language learning. Journal of Advanced Research in Applied Sciences and Engineering Technology, 38(1), 156–176. https://doi.org/10.37934/araset.38.1.156176
  6. Atayero, A. A., Popoola, S. I., Egeonu, J., & Oludayo, O. (2018). Citation analytics: Data exploration and comparative analyses of CiteScores of Open Access and Subscription-Based publications indexed in Scopus (2014–2016). Data in Brief, 19, 198–213. https://doi.org/10.1016/j.dib.2018.05.005
  7. Baas, J., Schotten, M., Plume, A., Côté, G., & Karimi, R. (2020). Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies. Quantitative Science Studies, 1(1), 377–386. https://doi.org/10.1162/qss_a_00019
  8. Bellido-García, R., Venturo-Orbegoso, C., Huaranga-Charapaqui, J., Sotomayor-Concepción, M., & Rejas-Borjas, L. G. (2024). Educational revolution: Bibliometric analysis of the advancement of artificial intelligence in education. International Journal of Engineering Trends and Technology, 72(6), 409–420. https://doi.org/10.14445/22315381/IJETT-V72I6P136
  9. Bittencourt, I. I., Chalco, G., Santos, J., Fernandes, S., Silva, J., Batista, N., Hutz, C., & Isotani, S. (2023). Positive artificial intelligence in education (P-AIED): A roadmap. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-023-00357-y
  10. Bırgın, O., & Peker, E. S. (2021). Thematic content analysis of studies on number sense in Turkey. Hacettepe Egitim Dergisi, 36(3), 593 – 609. https://doi.org/10.16986/HUJE.2020062666
  11. Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616–630. https://doi.org/10.1007/s11528-022-00715-y
  12. Chandra, K. R., Muthumanikandan, M., Kathyayini, S., Akhila, H. G., Pathak, P., & Shivaprakash, S. (2024). The impact of artificial intelligence tools and techniques for effective English language education. Nanotechnology Perceptions, 20(S7), 897–903. https://doi.org/10.62441/nano-ntp.v20iS7.74
  13. Chen, C. H. (2020). AR videos as scaffolding to foster students’ learning achievements and motivation in EFL learning. British Journal of Educational Technology, 51(3), 657–672. https://doi.org/10.1111/bjet.12902
  14. Chen, Y.-L., Hsu, C.-C., Lin, C.-Y., & Hsu, H.-H. (2022). Robot-assisted language learning: Integrating artificial intelligence and virtual reality into English tour guide practice. Education Sciences, 12(7), 437. https://doi.org/10.3390/educsci12070437
  15. Chu, H. C., Hwang, G. H., Tu, Y. F., & Yang, K. H. (2022). Roles and research trends of artificial intelligence in higher education: A systematic review of the top 50 most-cited articles. Australasian Journal of Educational Technology, 38(3), 22–42. https://doi.org/10.14742/ajet.7526
  16. Dinçer, S. (2018). Content analysis in scientific research: Meta-analysis, meta-synthesis, and descriptive content analysis. Bartın Üniversitesi Eğitim Fakültesi Dergisi, 7(1), 176–190. https://doi.org/10.14686/buefad.363159
  17. Divekar, R. R., Drozdal, J., Chabot, S., Yalun, Z., Su, H., Chen, Y., Zhu, H., Hendler, J., & Braasch, J. (2022). Foreign language acquisition via artificial intelligence and extended reality: design and evaluation. Computer Assisted Language Learning, 35(9), 2332–2360. https://doi.org/10.1080/09588221.2021.1879162
  18. Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of Business Research, 133, 285–296. https://doi.org/10.1016/j.jbusres.2021.04.070
  19. Ebadi, S., & Amini, A. (2024). Examining the roles of social presence and human-likeness on Iranian EFL learners’ motivation using artificial intelligence technology: a case of CSIEC chatbot. Interactive Learning Environments, 1–19. https://doi.org/10.1080/10494820.2022.2096638
  20. Ericsson, E., Sofkova Hashemi, S., & Lundin, J. (2023). Fun and frustrating: Students’ perspectives on practising speaking English with virtual humans. Cogent Education, 10(1), 2170088. https://doi.org/10.1080/2331186X.2023.2170088
  21. Farrelly, T., & Baker, N. (2023). Generative artificial intelligence: Implications and considerations for higher education practice. Education Sciences, 13(11). https://doi.org/10.3390/educsci13111109
  22. Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121(February), 103254. https://doi.org/10.1016/j.system.2024.103254
  23. Galindo-Domínguez, H., Delgado, N., Losada, D., & Etxabe, J.-M. (2024). An analysis of the use of artificial intelligence in education in Spain: The in-service teacher’s perspective. Journal of Digital Learning in Teacher Education, 40(1), 41–56. https://doi.org/10.1080/21532974.2023.2284726
  24. Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing assistant’s impact on English language learners. Computers and Education: Artificial Intelligence, 3(January), 100055. https://doi.org/10.1016/j.caeai.2022.100055
  25. Hew, K. F., Huang, W., Du, J., & Jia, C. (2023). Using chatbots to support student goal setting and social presence in fully online activities: learner engagement and perceptions. Journal of Computing in Higher Education, 35(1), 40–68. https://doi.org/10.1007/s12528-022-09338-x
  26. Hmoud, M., Swaity, H., Hamad, N., Karram, O., & Daher, W. (2024). Higher education students’ task motivation in the generative artificial intelligence context: The case of ChatGPT. Information, 15(1). https://doi.org/10.3390/info15010033
  27. Hockly, N. (2023). Artificial intelligence in English language teaching: The good, the bad and the ugly. RELC Journal, 54(2), 445–451. https://doi.org/10.1177/00336882231168504
  28. Hsu, T.-C. (2017). Learning English with augmented reality: Do learning styles matter? Computers and Education, 106, 137 – 149. https://doi.org/10.1016/j.compedu.2016.12.007
  29. Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. https://doi.org/10.1111/jcal.12610
  30. Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, research issues and applications of artificial intelligence in language education. Educational Technology & Society, 26(1), 112–131. https://doi.org/10.30191/ETS.202301_26(1).0009
  31. Ivanova, M., Grosseck, G., & Holotescu, C. (2024). Unveiling insights: A bibliometric analysis of artificial intelligence in teaching. Informatics, 11(1), 10. https://doi.org/10.3390/informatics11010010
  32. Jeanjaroonsri, R. (2023). Thai EFL Learners’ use and perceptions of mobile technologies for writing. LEARN Journal: Language Education and Acquisition Research Network, 16(1), 169–193. https://so04.tci-thaijo.org/index.php/LEARN/article/view/263438
  33. Jeon, J. (2023). Chatbot-assisted dynamic assessment (CA-DA) for L2 vocabulary learning and diagnosis. Computer Assisted Language Learning, 36(7), 1338–1364. https://doi.org/10.1080/09588221.2021.1987272
  34. Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20(1), 37. https://doi.org/10.1186/s41239-023-00406-5
  35. Junaidi, J., Hamuddin, B., Julita, K., Rahman, F., & Derin, T. (2020). Artificial intelligence in EFL context: Rising students’ speaking performance with Lyra Virtual assistance. International Journal of Advanced Science and Technology, 29(05 SE-Articles), 6735–6741. http://sersc.org/journals/index.php/IJAST/article/view/17726
  36. Khasawneh, M. A. S. (2024). Analyzing the strategic effects of AI-Powered virtual and augmented reality systems in english language Education at the tertiary level. Research Journal in Advanced Humanities, 5(3), 188 – 202. https://doi.org/10.58256/j74yfg59
  37. Khiem, H. G., Huong, H. L., Triet, M. N., Khanh, H. V., Phuc, N. T., Khoa, T. D., Hien, N. Q., Tung, L. K., Nam, T. B., Vinh, N. T., Kha, N. H., Thuan, Q. T., Bang, L. K., Minh, N. V., Ngan, N. T. K., & Quy, T. L. (2024). Generative AI in English education: Harnessing ChatGPT for digital learning. 8th International Symposium on Emerging Technologies for Education, 147–157. https://doi.org/10.1007/978-981-97-4246-2_13
  38. Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022). Explainable artificial intelligence in education. Computers and Education: Artificial Intelligence, 3, 100074. https://doi.org/10.1016/j.caeai.2022.100074
  39. Khoudri, I., Zeriouh, M., Fauzan, U., & Khoudri, A. (2024). The use of AI in learning English: A comparative study between Moroccan and Indonesian undergraduate students from the English department. Edelweiss Applied Science and Technology, 8(4), 1271–1282. https://doi.org/10.55214/25768484.v8i4.1504
  40. Kim, N. (2019). A study on the use of artificial intelligence Chatbots for improving English grammar skills. Journal of Digital Convergence, 17, 89–110. https://doi.org/10.14400/JDC.2019.17.8.037
  41. Kohnke, L. (2023). A pedagogical chatbot: A supplemental language learning tool. RELC Journal, 54(3), 828–838. https://doi.org/10.1177/00336882211067054
  42. Liang, J.-C., Hwang, G.-J., Chen, M.-R. A., & Darmawansah, D. (2023). Roles and research foci of artificial intelligence in language education: An integrated bibliographic analysis and systematic review approach. Interactive Learning Environments, 31(7), 4270–4296. https://doi.org/10.1080/10494820.2021.1958348
  43. Lin, M. P.-C., & Chang, D. (2020). Enhancing post-secondary writers’ writing skills with a chatbot. Journal of Educational Technology & Society, 23(1), 78–92. https://www.jstor.org/stable/26915408
  44. Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki. (2023). Exploring artificial intelligence in academic essay: Higher education student’s perspective. International Journal of Educational Research Open, 5, 100296. https://doi.org/10.1016/j.ijedro.2023.100296
  45. Maphosa, V., & Maphosa, M. (2023). Artificial intelligence in higher education: a bibliometric analysis and topic modeling approach. Applied Artificial Intelligence, 37(1), 2261730. https://doi.org/10.1080/08839514.2023.2261730
  46. Matsuda, N., Weng, W., & Wall, N. (2020). The Effect of metacognitive scaffolding for learning by teaching a teachable agent. International Journal of Artificial Intelligence in Education, 30(1), 1–37. https://doi.org/10.1007/s40593-019-00190-2
  47. Mayr, P., Frommholz, I., Cabanac, G., Chandrasekaran, M. K., Jaidka, K., Kan, M. Y., & Wolfram, D. (2018). Introduction to the special issue on bibliometric-enhanced information retrieval and natural language processing for digital libraries (BIRNDL). International Journal on Digital Libraries, 19(2–3), 107–111. https://doi.org/10.1007/s00799-017-0230-x
  48. Odden, T. O. B., Marin, A., & Rudolph, J. L. (2021). How has science education changed over the last 100 years? An analysis using natural language processing. Science Education, 105(4), 653–680. https://doi.org/10.1002/sce.21623
  49. Ouyang, F., & Jiao, P. (2021). Artificial intelligence in education: The three paradigms. Computers and Education: Artificial Intelligence, 2, 100020. https://doi.org/10.1016/j.caeai.2021.100020
  50. Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372. https://doi.org/10.1136/bmj.n71
  51. Prahani, B. K., Rizki, I. A., Jatmiko, B., Suprapto, N., & Amelia, T. (2022). Artificial intelligence in education research during the last ten years: A review and bibliometric study. International Journal of Emerging Technologies in Learning, 17(8), 169–188. https://doi.org/10.3991/ijet.v17i08.29833
  52. Pranckutė, R. (2021). Web of Science (WoS) and Scopus: the titans of bibliographic information in today’s academic world. Publications, 9(1). https://doi.org/10.3390/publications9010012
  53. Rogers, G., Szomszor, M., & Adams, J. (2020). Sample size in bibliometric analysis. Scientometrics, 125(1), 777–794. https://doi.org/10.1007/s11192-020-03647-7
  54. Saeed Ahmed Mohamed, S., & Mahmoud Ibrahim Alian, E. (2023). Students’ attitudes toward using chatbot in EFL learning. Arab World English Journal, 14(3), 15–27. https://doi.org/10.24093/awej/vol14no3.2
  55. Sajja, R., Sermet, Y., Cwiertny, D., & Demir, I. (2023). Platform-independent and curriculum-oriented intelligent assistant for higher education. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00412-7
  56. Schmidt-Fajlik, R. (2023). ChatGPT as a grammar checker for Japanese English language learners: A comparison with Grammarly and ProWritingAid. AsiaCALL Online Journal, 14(1 SE-Research Article), 105–119. https://doi.org/10.54855/acoj.231417
  57. Su, Y., Lin, Y., & Lai, C. (2023). Collaborating with ChatGPT in argumentative writing classrooms. Assessing Writing, 57, 100752. https://doi.org/10.1016/j.asw.2023.100752
  58. Utami, S. P. T., Andayani, Winarni, R., & Sumarwati. (2023). Utilization of artificial intelligence technology in an academic writing class: How do Indonesian students perceive? Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13419
  59. Wahyuni, S, & Etfita, F. (2019). Designing an Android smartphone app for office English: Focus on students’ opinions toward the app. International Journal of Recent Technology and Engineering, 8(2), 152–158. http://www.scopus.com/inward/record.url?eid=2-s2.0-85070715632&partnerID=MN8TOARS
  60. Wahyuni, Sri, & Etfita, F. (2023). The application of Kahoot as an online assessment tool to foster student’s engagement: Student’s experiences and voices. Register Journal, 16(2), 248–266. https://doi.org/10.18326/register.v16i2.248-266
  61. Wang, C.-Y., & Lin, J. J. H. (2023). Utilizing artificial intelligence to support analyzing self-regulated learning: A preliminary mixed-methods evaluation from a human-centered perspective. Computers in Human Behavior, 144, 107721. https://doi.org/10.1016/j.chb.2023.107721
  62. Wang, X., Liu, Q., Pang, H., Tan, S. C., Lei, J., Wallace, M. P., & Li, L. (2023). What matters in AI-supported learning: A study of human-AI interactions in language learning using cluster analysis and epistemic network analysis. Computers & Education, 194, 104703. https://doi.org/10.1016/j.compedu.2022.104703
  63. Wang, Z. (2022). Computer-assisted EFL writing and evaluations based on artificial intelligence: a case from a college reading and writing course. Library Hi Tech, 40(1), 80–97. https://doi.org/10.1108/LHT-05-2020-0113
  64. Wei, L. (2023). Artificial intelligence in language instruction: Impact on English learning achievement, L2 motivation, and self-regulated learning. Frontiers in Psychology, 14, null. https://doi.org/10.3389/fpsyg.2023.1261955
  65. Winaitham, W. (2022). The scientific review of AI functions of enhancement English learning and teaching. 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), 148–152. https://doi.org/10.1109/ICTC55196.2022.9952632
  66. Xie, H., Chu, H. C., Hwang, G. J., & Wang, C. C. (2019). Trends and development in technology-enhanced adaptive/personalized learning: A systematic review of journal publications from 2007 to 2017. Computers and Education, 140(June), 103599. https://doi.org/10.1016/j.compedu.2019.103599
  67. Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies, 28(11), 13943–13967. https://doi.org/10.1007/s10639-023-11742-4
  68. Yang, H., Kim, H., Lee, J. H., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 34(3), 327–343. https://doi.org/10.1017/S0958344022000039
  69. Younis, H. A., Mohammed Alyasiri, O., Mueen Sahib, T., Hayder, I. M., Salisu, S., Shahid, M., Al Asyariah Mandar, U., Barat Indonesia, S., Jammu, A., & Corresponding Author, K. (2023). ChatGPT evaluation: Can it replace Grammarly and Quillbot tools? British Journal of Applied Linguistics, 3(2), 34–48. https://doi.org/10.32996/bjal
  70. Yun, C.-O., Jung, S.-J., & Yun, T.-S. (2024). Interactive learning tutor service platform based on artificial intelligence in a virtual reality environment. 15th International Conference on Intelligent Human Computer Interaction, 367–373. https://doi.org/10.1007/978-3-031-53827-8_32
  71. Zhang, K., & Aslan, A. B. (2021). AI technologies for education: Recent research & future directions. Computers and Education: Artificial Intelligence, 2, 100025. https://doi.org/10.1016/j.caeai.2021.100025
  72. Zhang, X., & Umeanowai, K. O. (2024). Exploring the transformative influence of artificial intelligence in EFL context: A comprehensive bibliometric analysis. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12937-z
  73. Zupic, I., & Čater, T. (2015). Bibliometric methods in management and organization. Organizational Research Methods, 18(3), 429–472. https://doi.org/10.1177/1094428114562629

Downloads

Published

2024-12-30

How to Cite

Wahyuni, S., Hidayanto Pancoro Setyo Putro, N., & Efendi, A. (2024). TRENDS IN ARTIFICIAL INTELLIGENCE-INFUSED ENGLISH LANGUAGE LEARNING: A COMPREHENSIVE BIBLIOMETRIC AND CONTENT REVIEW . Advanced Education, 12(25), 162–178. https://doi.org/10.20535/2410-8286.315035

Issue

2024: Issue 25

Section

Literature Review

License

Copyright (c) 2024 Sri Wahyuni, Nur Hidayanto Pancoro Setyo Putro, Anwar Efendi. The cover image is derived from Biblioshiny

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

    1. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

  1. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).