Impact of Artificial Intelligence Chatbots on Student Well-being and Mental Health: A Systematic Review

Authors

DOI:

https://doi.org/10.31098/pba.v2i2.2411

Keywords:

Artificial Intelligence; Chatbot; Mental Health; Student; Systematic Review; Well-Being

Abstract

Students in schools and colleges face some challenges, including rigorous academic schedules, academic work load, standardized tests, and assignments deadline, which can contribute to significant stress and mental health risks. Thus, numerous studies have been conducted to control stress between students, such as self-guided stress management programs. This paper reviews several studies published between 2019 and 2023 exploring the impacts of deploying state-of-the-art artificial intelligence chatbots which are used to boost and manage psychological disorders and mental health symptoms such as anxiety, depression, fear, and worry between prospective and current undergraduate students. This study outlines the key phases of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). It begins with screening (115) articles and subsequently includes (13) articles for intensive review, which all focus on psychological disorders and mental health conditions that can be influenced by the conversational agents and chatbots. However, the results revealed that anxiety and depression are the main psychological disorders that can be influenced by conversational agents and chatbots. Moreover, this review revealed multiple cases of universities and schools, emphasizing the implementation of chatbots for both learning and advising functions.  The Systematic Literature Review (SLR) in this study is constrained to the specific databases, and the search keywords were limited to the article title fields only; which excluded the abstracts. This could have caused some missing relevant studies. In future work, other essential databases will be included, such as Scopus and WoS. In addition, we will include more information about the technique and the complexities of using the chatbot as it may have a significant impact on student behaviors and emotions.

References

Abramski, K., Citraro, S., Lombardi, L., Rossetti, G., & Stella, M. (2023). Cognitive network science reveals bias in GPT-3, ChatGPT, and GPT-4 mirroring math anxiety in high-school students. arXiv preprint arXiv:2305.18320.

Abreu, C., & Campos, P. F. (2022, February). Raising awareness of smartphone overuse among university students: a persuasive systems approach. In Informatics (Vol. 9, No. 1, p. 15). MDPI.

Ahn, S. (2022). The Effects of Chatbot on Grammar Competence for Korean EFL College Students. Journal of Digital Convergence, 20(3).

Agarwal, S., & Linh, N. T. D. (2021). A study of student's subjective well-being through a chatbot in higher education. Further Advances in Internet of Things in Biomedical and Cyber-Physical Systems, 383-403.

Amanvermez, Y., Rahmadiana, M., Karyotaki, E., de Wit, L., Ebert, D. D., Kessler, R. C., & Cuijpers, P. (2020). Stress management interventions for college students: A systematic review and meta-analysis. Clinical Psychology: Science and Practice.

American College Health Association. (2021). National College Health Assessment III Fall 2021 Undergraduate Reference Group Executive Summary https://www.acha.org/documents/ncha/NCHA

American Psychological Association. Students Experiencing Stress Accessed. July 1st, 2023. Accessed https://www.apa.org/ed/schools/primer/stress

Assayed, Suha, Khaled Shaalan, and Manar Alkhatib. "A Chatbot Intent Classifier for Supporting High School Students." EAI Endorsed Transactions on Scalable Information Systems 1 (2023).

Assayed, S., Shaalan, K., Al-Sayed, S., & Alkhatib, M. (2023). Psychological Emotion Recognition of Students Using Machine Learning based Chatbot. International Journal of Artificial Intelligence and Applications (IJAIA), 14(2).

Ayanouz, S., Abdelhakim, B. A., & Benhmed, M. (2020, March). A smart chatbot architecture based on NLP and machine learning for health care assistance. In Proceedings of the 3rd International Conference on Networking, Information Systems & Security (pp. 1-6).

Azim, S. R., & Baig, M. (2019). Frequency and perceived causes of depression, anxiety, and stress among medical students of a private medical institute in Karachi: a mixed method study. J Pak Med Assoc, 69(6), 840-845.

Beredo, J. (2022). VHope: An empathetic virtual hope chatbot using a neural conversational model for student's mental well-being. Software Technology Master’s Theses.

Bilquise, G., Ibrahim, S., & Shaalan, K. (2022). Bilingual AI-Driven Chatbot for Academic Advising. International Journal of Advanced Computer Science and Applications, 13(8).

Çakmak, F. (2022). Chatbot-Human Interaction and Its Effects on EFL Students' L2 Speaking Performance and Anxiety. Novitas-ROYAL (Research on Youth and Language), 16(2), 113-131.

Cooper, H. M. (1985). A Taxonomy of Literature Reviews.

Cunningham-Nelson, S., Boles, W., Trouton, L., & Margerison, E. (2019). A review of chatbots in education: practical steps forward. In 30th annual conference for the Australasian Association for engineering education (AAEE 2019): educators becoming agents of Change: innovate, integrate, motivate (pp. 299-306). Engineers Australia.

De Nieva, J. O., Joaquin, J. A., Tan, C. B., Marc Te, R. K., & Ong, E. (2020, October). Investigating students’ use of a mental health chatbot to alleviate academic stress. In 6th International ACM In-Cooperation HCI and UX Conference (pp. 1-10).

Dhanasekar, V., Preethi, Y., Vishali, S., & IR, P. J. (2021, September). A chatbot to promote students' mental health through emotion recognition. In 2021 Third International Conference on Inventive Research in Computing Applications (ICIRCA) (pp. 1412-1416). IEEE.

El Hefny, W., Mansy, Y., Abdallah, M., & Abdennadher, S. (2021). Jooka: a bilingual chatbot for university admission. In Trends and Applications in Information Systems and Technologies: Volume 3 9 (pp. 671-681). Springer International Publishing.

Haristiani, N. (2019, November). Artificial Intelligence (AI) chatbot as language learning medium: An inquiry. In Journal of Physics: Conference Series (Vol. 1387, No. 1, p. 012020). IOP Publishing.

Hernández-Torrano, D., Ibrayeva, L., Sparks, J., Lim, N., Clementi, A., Almukhambetova, A., ... & Muratkyzy, A. (2020). Mental health and well-being of university students: A bibliometric mapping of the literature. Frontiers in Psychology, 11, 1226.

Hsu, T. C., Huang, H. L., Hwang, G. J., & Chen, M. S. (2023). Effects of Incorporating an Expert Decision-making Mechanism into Chatbots on Students’ Achievement, Enjoyment, and Anxiety. Educational Technology & Society, 26(1), 218-231.

Kapoor, A., & Goel, S. (2022, April). Applications of Conversational AI in Mental Health: A Survey. In 2022 6th International Conference on Trends in Electronics and Informatics (ICOEI) (pp. 1013-1016). IEEE.

Kasthuri, E., & Balaji, S. (2021, February). A chatbot for changing lifestyles in education. In 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV) (pp. 1317-1322). IEEE.

Klos, M. C., Escoredo, M., Joerin, A., Lemos, V. N., Rauws, M., & Bunge, E. L. (2021). Artificial intelligence–based chatbot for anxiety and depression in university students: a pilot randomized controlled trial. JMIR formative research, 5(8), e20678.

Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 00336882231162868.

Kuhail, M. A., Al Katheeri, H., Negreiros, J., Seffah, A., & Alfandi, O. (2023). Engaging students with a chatbot-based academic advising system. International Journal of Human–Computer Interaction, 39(10), 2115-2141.

Lattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019). Digital mental health interventions for depression, anxiety, and enhancement of psychological well-being among college students: a systematic review. Journal of medical Internet research, 21(7), e12869.

Lattie, E. G., Lipson, S. K., & Eisenberg, D. (2019). Technology and college student mental health: challenges and opportunities. Frontiers in psychiatry, 10, 246.

Li, L., Ma, Z., Fan, L., Lee, S., Yu, H., & Hemphill, L. (2023). ChatGPT in education: A discourse analysis of worries and concerns on social media. arXiv preprint arXiv:2305.02201.

Lin, A. P., Trappey, C. V., Luan, C. C., Trappey, A. J., & Tu, K. L. (2021). A Test Platform for Managing School Stress Using a Virtual Reality Group Chatbot Counseling System. Applied Sciences, 11(19), 9071.

Lin, Y. T., & Ye, J. H. (2023). Development of an Educational Chatbot System for Enhancing Students’ Biology Learning Performance. Journal of Internet Technology, 24(2), 275-281.

Liu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022). Using AI chatbots to provide self-help depression interventions for university students: a randomized trial of effectiveness. Internet Interventions, 27, 100495.

Lucero Fredes, A., Cano, S., Cubillos, C., & Díaz, M. E. (2022, October). Virtual Assistant as an Emotional Support for the Academic Stress for Students of Higher School: A Literature Review. In HCI International 2022–Late Breaking Papers: HCI for Health, Well-being, Universal Access, and Healthy Aging: 24th International Conference on Human-Computer Interaction, HCII 2022, Virtual Event, June 26–July 1, 2022, Proceedings (pp. 108-118). Cham: Springer Nature Switzerland.

Luo, X., Tong, S., Fang, Z., & Qu, Z. (2019). Frontiers: Machines vs. humans: The impact of artificial intelligence chatbot disclosure on customer purchases. Marketing Science, 38(6), 937-947.

Man, S. C., Matei, O., Faragau, T., Andreica, L., & Daraba, D. (2023). The Innovative Use of Intelligent Chatbot for Sustainable Health Education Admission Process: Learnt Lessons and Good Practices. Applied Sciences, 13(4), 2415.

Mazumder, S., & Liu, B. (2022, July). Continual Learning Dialogue Systems-Learning during Conversation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 3429-3432).

McTear, M. (2020). Conversational ai: Dialogue systems, conversational agents, and chatbots. Synthesis Lectures on Human Language Technologies, 13(3), 1-251.

Mofatteh, M. (2021). Risk factors associated with stress, anxiety, and depression among university undergraduate students. AIMS Public Health, 8(1), 36.

Paolini, A. C. (2019). School counselors promoting college and career readiness for high school students. Journal of School Counseling, 17(2), n2.

Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28(6), 1549-1565.

Sallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023). ChatGPT applications in medical, dental, pharmacy, and public health education: A descriptive study highlighting the advantages and limitations. Narra J, 3(1), e103-e103.

Ryong, K., Lee, D., & Lee, J. G. (2023). Chatbot’s Complementary Motivation Support in Developing Study Plan of E-Learning English Lecture. International Journal of Human–Computer Interaction, 1-15.

Sia, D. E., Yu, M. J., Daliva, J. L., Montenegro, J., & Ong, E. (2021, May). Investigating the acceptability and perceived effectiveness of a chatbot in helping students assess their well-being. In Asian CHI Symposium 2021 (pp. 34-40).

Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for Facebook Messenger. Computers & Education, 151, 103862.

Trappey, A. J., Lin, A. P., Hsu, K. Y., Trappey, C. V., & Tu, K. L. (2022). Development of an empathy-centric counseling chatbot system capable of sentimental dialogue analysis. Processes, 10(5), 930.

Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021). Are we there yet?-a systematic literature review on chatbots in education. Frontiers in artificial intelligence, 4, 654924.

Woodward, K., Kanjo, E., Brown, D. J., McGinnity, T. M., Inkster, B., Macintyre, D. J., & Tsanas, A. (2020). Beyond mobile apps: a survey of technologies for mental well-being. IEEE Transactions on Affective Computing, 13(3), 1216-1235.

World Health Organization. Mental health: strengthening our response. Accessed July 1st, 2023 https://www.who.int/news-room/fact-sheets/detail/mental-health-strengthening-our-response

Downloads

Article Metrics

Published

September 30, 2024

Citation Check

How to Cite

Alsayed, S. ., Assayed, S. K. ., Alkhatib, M. ., & Shaalan, K. . (2024). Impact of Artificial Intelligence Chatbots on Student Well-being and Mental Health: A Systematic Review. People and Behavior Analysis, 2(2), 1–13. https://doi.org/10.31098/pba.v2i2.2411

Issue

Section

Research Articles

Article Index