The Effectiveness of PolyAI on Students' Academic Performance

Putri Ajeng Natalia, Abdul Halim*

Abstract


To prevent misuse, it is crucial to utilise Artificial Intelligence (AI) efficiently due to its growing prevalence. A chatbot is an artificial intelligence system that imitates human conversation. Chatbots can be used effectively in the field of education when used properly. This research explores the utilisation and integration of the chatbot PolyAI to enhance English language learning for students at MAN 1 Samarinda. This study aims to investigate the effectiveness of PolyAI on students’ academic performance. The aim was to offer fresh viewpoints that enhance the ongoing discussion on integrating artificial intelligence into education. This study utilises a quasi-experimental methodology; pre- and post-test assessments were used in a quasi-experimental research method to examine PolyAI's impact on students' academic achievement. The collected data has been analysed using the Statistical Package for the Social Sciences (SPSS) to identify the effectiveness of PolyAI on students’ achievement. The study found that the control group had a lower mean score and greater variation among individual scores, indicating a significant difference in data. The experimental group had a higher mean score and a smaller variation, suggesting more homogeneous and consistent data. The independent sample t-test showed a significant effect of PolyAI chatbot involvement on improving English language skills, indicating a positive effect.


Keywords


Artificial Intelligence, chatbot, education, student, learning

Full Text:

PDF

References


Abulibdeh, A., Zaidan, E., & Abulibdeh, R. (2024). Navigating the confluence of artificial intelligence and education for sustainable development in the era of industry 4.0: Challenges, opportunities, and ethical dimensions. Journal of Cleaner Production, 437, 140527.

Ayeni, O. O., Al Hamad, N. M., Chisom, O. N., Osawaru, B., & Adewusi, O. E. (2024). AI in education: A review of personalized learning and educational technology. GSC Advanced Research and Reviews, 18(2), 261-271.

Chen, X., Xie, H., Zou, D., & Hwang, G. J. (2020). Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence, 1, 100002.

Essel, H. B., Vlachopoulos, D., Tachie-Menson, A., Johnson, E. E., & Baah, P. K. (2022). The impact of a virtual teaching assistant (chatbot) on students' learning in Ghanaian higher education. International Journal of Educational Technology in Higher Education, 19(1), 1-19.

Ferrari, A., Cachia, R., & Punie, Y. (2009). Innovation and creativity in education and training in the EU member states: Fostering creative learning and supporting innovative teaching. JRC Technical Note, 52374, 64.

Geng, S., Law, K. M., & Niu, B. (2019). Investigating self-directed learning and technology readiness in blending learning environment. International journal of educational technology in higher education, 16(1), 1-22.

Srikaanth, P. B. (2024). The Erosion of Cognitive Skills in the Technological Age: How Reliance on Technology Impacts Critical Thinking, Problem-Solving, and Creativity. https://doi.org/10.5281/zenodo.11671150

Guan, C., Mou, J., & Jiang, Z. (2020). Artificial intelligence innovation in education: A twenty-year data-driven historical analysis. International Journal of Innovation Studies, 4(4), 134-147.

Gupta, S., & Chen, Y. (2022). Supporting inclusive learning using chatbots? A chatbot-led interview study. Journal of Information Systems Education, 33(1), 98-108.

Khensous, G., Labed, K., & Labed, Z. (2023). Exploring the evolution and applications of natural language processing in education. Revista Română de Informatică și Automatică, 33(2), 61-74.

Khurana, D., Koli, A., Khatter, K., & Singh, S. (2023). Natural language processing: state of the art, current trends and challenges. Multimedia tools and applications, 82(3), 3713-3744.

Kumar, A., Nayyar, A., Sachan, R. K., & Jain, R. (2023). AI-assisted special education for students with exceptional needs. In AI-Assisted Special Education for Students With Exceptional Needs. IGI Global. https://doi.org/10.4018/979-8-3693-0378-8

Leite, A., & Blanco, S. A. (2020, February). Effects of human vs. automatic feedback on students' understanding of AI concepts and programming style. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (pp. 44-50).

Limna, P., Kraiwanit, T., Jangjarat, K., Klayklung, P., & Chocksathaporn, P. (2023). The use of ChatGPT in the digital era: Perspectives on chatbot implementation. Journal of Applied Learning and Teaching, 6(1).

Luna. (2024). How To Use Poly.ai? A Step-By-Step Guide. Aitoolmall. https://aitoolmall.com/news/how-to-use-poly-ai/

Loeb, S., Dynarski, S., Mcfarland, D., Morris, P., Reardon, S., & Reber, S. (2017). Descriptive analysis in education: A guide for researchers The National Center for Education Evaluation and Regional Assistance (NCEE) conducts unbiased large-scale evaluations of education programs and practices. http://ies.ed.gov/ncee/.

Maghsudi, S., Lan, A., Xu, J., & van Der Schaar, M. (2021). Personalized education in the artificial intelligence era: what to expect next. IEEE Signa Processing Magazine, 38(3), 37-50.

Nadkarni, P. M., Ohno-Machado, L., & Chapman, W. W. (2011). Natural language processing: an introduction. Journal of the American Medical Informatics Association, 18(5), 544-551.

Pokrivcakova, S. (2019). Preparing teachers for the application of AI-powered technologies in foreign language education. Journal of Language and Cultural Education, 7(3), 135-153.

Rogers, J., & Revesz, A. (2019). Experimental and quasi-experimental designs. In The Routledge handbook of research methods in applied linguistics (pp. 133-143). Routledge.

Shah, V. (2020). Advancements in Deep Learning for Natural Language Processing in Software Applications. International Journal of Computer Science and Technology, 4(3), 45-56.

Shahzad, M. F., Xu, S., Lim, W. M., Yang, X., & Khan, Q. R. (2024). Artificial intelligence and social media on academic performance and mental well-being: Student perceptions of positive impact in the age of smart learning. Heliyon, 10(8).

Stratton, S. J. (2019). Quasi-experimental design (pre-test and post-test studies) in prehospital and disaster research. Prehospital and disaster medicine, 34(6), 573-574.

Tetzlaff, L., Schmiedek, F., & Brod, G. (2021). Developing personalized education: A dynamic framework. Educational Psychology Review, 33, 863-882.

Younis, H. A., Ruhaiyem, N. I. R., Ghaban, W., Gazem, N. A., & Nasser, M. (2023). A Systematic Literature Review on the Applications of Robots and Natural Language Processing in Education. Electronics, 12(13), 2864.




DOI: https://doi.org/10.24815/jimps.v9i3.31253

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

JIMPS: Jurnal Ilmiah Mahasiswa Pendidikan Sejarah indexed by

sinta_logodoaj_logoDimensions_logoCROSSREF_logoROAD_logoPKP_Index_logoGoogle_Scholar_logogaruda_logoonesearch_logoBASE_logoWordcat_logo

___________________________________________________________
JIMPS: Jurnal Ilmiah Mahasiswa Pendidikan Sejarah

E-ISSN 2614-3658
P-ISSN 2964-7231

Published by History Education Department, Faculty of Teacher Training and Education, Universitas Syiah Kuala in collaboration with "Perkumpulan Prodi Pendidikan Sejarah Se- Indonesia"
W :https://jim.unsyiah.ac.id/sejarah
E : jimsejarah@usk.ac.id

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0