Articles
Vol. 4 No. 1 (2025): Generative AI and education
Assessment of United Kingdom (UK) further education student perceptions of the significance of ChatGPT on learning experiences in business studies: An integrative literature review
Department of Educational Research, Lancaster University, Lancaster, United Kingdom
Abstract
This integrative literature review uses an interdisciplinary approach to synthesise aspects of generative artificial intelligence-related studies from health sciences, meteorology, business, and higher education. The goal is to understand end-user perceptions of GenAI chatbots and integrate these insights into using ChatGPT in technology-enhanced learning (TEL) in teaching business studies courses in the United Kingdom’s (UK’s) further education sector. The study examines the benefits, such as personalised learning and access to knowledge resources, and limitations, like the inability to match human interaction. The review highlights a scarcity of research on student perceptions of GenAI chatbots in the UK. This paper employs an integrative literature review approach, analysing thirty-seven papers from the databases Google Scholar, ERIC, and Lancaster University’s OneSearch. The author identifies five themes: benefits; limitations; factors influencing the effectiveness of GenAI chatbots; perceptions; and human-GenAI interaction. Findings reveal patterns in chatbot use and emphasise the need for further empirical research on student perspectives. The paper argues that understanding student perceptions is important when integrating GenAI tools like ChatGPT in TEL research and the teaching of business. This paper advocates for UK-specific studies to inform TEL researchers, educators, policymakers, and developers within the relevant context.
References
- Barrett, M., Branson, L., Carter, S., DeLeon, F., Ellis, J., Gundlach, C., & Lee, D. (2019). Using artificial intelligence to enhance educational opportunities and student services in higher education. Inquiry: The Journal of the Virginia Community Colleges, 22(1). https://commons.vccs.edu/inquiry/vol22/iss1/11
- Bollen, J., Eva, A. M., van Dis, R., van Rooij, W., Zuidema, W., & Bockting, C. L. (2023). ChatGPT: Five priorities for research. Nature, 614(7947), 224–226. https://doi.org/10.1038/d41586-023-00288-7
- Broughman, D., & Haar, J. (2018). Smart technology, artificial intelligence, robotics, and algorithms (STARA): Employees’ perceptions of our future workplace. Journal of Management & Organisation, 24(2), 239–257. https://doi.org/10.1017/jmo.2016.55
- Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the feasibility of ChatGPT in healthcare: An analysis of multiple clinical and research scenarios. Journal of Medical Systems, 47(1), 33. https://doi.org/10.1007/s10916-023-01925-4
- Chang, C.-Y., Kuo, S.-Y., & Hwang, G.-H. (2022). Chatbot-facilitated nursing education: Incorporating a knowledge-based chatbot system into a nursing training program. Educational Technology & Society, 25(1), 15–27.
- Chaoning, Z., Chenshuang, Z., Sheng, Z., Qiao, Y., Chenghao, L., Mengchun, Z., Sumit, K. D., Thwal, C. M., Ye, L. T., Le, L. H., Donguk, K., Sung, H. B., Lik, H. L., Yang, Y., Heng, T. S., Kweon, I. S., & Hong, C. S. (2022). A complete survey on generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 all you need? Computer Science: Artificial Intelligence, 1(1), 56 pages. https://doi.org/10.48550/arXiv.2303.11717
- Chen, H., Chan-Olmsted, S., Kim, J., & Sanabria, I. M. (2022). Consumers’ perception on artificial intelligence applications in marketing communication. Qualitative Market Research: An International Journal, 25(1), 125–142. https://doi.org/10.1108/QMR-03-2021-0040
- Chen, J., Guo, F., Ren, Z., Wang, X., & Ham, J. (2023). Human-chatbot interaction studies through the lens of bibliometric analysis. Universal Access in the Information Society. Advance online publication. https://doi.org/10.1007/s10209-023-01058-y
- Clarke, V., & Braun, V. (2017). Thematic analysis. The Journal of Positive Psychology, 12(3), 297–298. https://doi.org/10.1080/17439760.2016.1262613
- Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2190148
- Doshi, R. H., Bajaj, S. S., & Krumholz, H. M. (2023). ChatGPT: Temptations of progress. The American Journal of Bioethics, 23(4), 6–8. https://doi.org/10.1080/15265161.2023.2180110
- Dempere, J., Modugu, K., Allam, H., Lakshmana, K., & Ramasamy, K. (2023). The impact of ChatGPT on higher education. Frontiers in Education. https://doi.org/10.3389/feduc.2023.1206936
- Durak, H. Y. (2022). Conversational agent-based guidance: Examining the effect of chatbot usage frequency and satisfaction on visual design self-efficacy, engagement, satisfaction, and learner autonomy. Education and Information Technologies, 28, 471–488. https://doi.org/10.1007/s10639-022-11149-7
- Gallacher, A., Thompson, A., & Howarth, M. (2018). “My robot is an idiot!” – Students’ perceptions of AI in the L2 classroom. In P. Taalas, J. Jalkanen, L. Bradley, & S. Thouësny (Eds.), Future-proof CALL: Language learning as exploration and encounters – Short papers from EUROCALL 2018 (pp. 70–76). Research-publishing.net. https://doi.org/10.14705/rpnet.2018.26.815
- Gonzalez, C. R., Padilla, C. R., Roman, P., & Sanchez-Labraca, N. S. (2022). Experiences and perceptions of final-year nursing students of using a chatbot in a simulated emergency: A qualitative study. Journal of Nursing Management. https://doi.org/10.1111/jonm.13630
- Gregorcic, B., & Pendrill, A. M. (2023). ChatGPT and the frustrated Socrates. Physics Education, 58(3), 035021. https://doi.org/10.1088/1361-6552/acc299
- Harrer, S. (2023). Attention is not all you need: The complicated case of ethically using large language models in healthcare and medicine. EBioMedicine, 90, 104512. https://doi.org/10.1016/j.ebiom.2023.104512
- Haug, C. J., M.D., & Drazen, M. J. (2023). Artificial intelligence and machine learning in clinical medicine. New England Journal of Medicine, 388, 12018. https://doi.org/10.1056/NEJMra2302038
- Hew, K. F., Huang, W., Du, J., & Chengyuan, J. (2023). Using chatbots to support student goal setting and social presence in fully online activities: Learner engagement and perceptions. Journal of Computing in Higher Education, 35, 40–68. https://doi.org/10.1007/s12528-022-09338-x
- Homolak, J. (2023). Opportunities and risks of ChatGPT in medicine, science, and academic publishing: A modern Promethean dilemma. Croatian Medical Journal, 64, 1–3.
- Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023). ChatGPT - Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39(2), 605–607. https://doi.org/10.12669/pjms.39.2.7653
- Kuhai, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28, 973–1018. https://doi.org/10.1007/s10639-022-11177-3
- Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: Systematic literature review. International Journal of Educational Technology in Higher Education, 20(56). https://doi.org/10.1186/s41239-023-00426-1
- Lee, Y.-F., Hwang, G.-J., & Chen, P.-Y. (2022). Impacts of an AI-based chatbot on college students' after-class review, academic performance, self-efficacy, learning attitude, and motivation. Educational Technology Research and Development, 70, 1843–1865. https://doi.org/10.1007/s11423-022-10142-8
- Leoste, J., Õun, T., Loogma, K., & San Martín López, J. (2021). Designing training programs to introduce emerging technologies to future workers-A pilot study based on the example of artificial intelligence-enhanced robotics. Mathematics, 9(22), 2876. https://doi.org/10.3390/math9222876
- Lund, B. D., Wang, T., Mannuru, R. N., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial intelligence-written research papers and the ethics of large language models in scholarly publishing. Association for Information Science and Technology, 74, 570–581. https://doi.org/10.1002/asi.24750
- Michalski, R. S., Carbonell, J. G., & Mitchell, T. M. (Eds.). (2013). Machine learning: An artificial intelligence approach. Springer Science & Business Media.
- Mohammadreza, F., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2195846
- Molnár, G., & Szűts, Z. (2018). The role of chatbots in formal education. In SISY 2018 IEEE 16th International Symposium on Intelligent Systems and Informatics (pp. 1-6). IEEE.
- Nouraldeen, R. M. (2022). The impact of technology readiness and use perceptions on students’ adoption of artificial intelligence: The moderating role of gender. Development and Learning in Organisations: An International Journal, Emerald Publishing Limited, 1-9. https://doi.org/10.1108/DLO-07-2022-0133
- Okonkwo, C. W., & Ade, A. A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033. https://www.sciencedirect.com/journal/computers-and-education-artificial-intelligence
- Passey, D. (2018). Technology enhanced learning: Rethinking the term, the concept, and its theoretical background. British Journal of Educational Technology, 50(3), 977–986. https://doi.org/10.1111/bjet.12708
- Pérez, J. Q., Daradoumis, T., Manuel, J., & Marquès Puig, M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28, 1549–1565. https://doi.org/10.1002/cae.22326
- Ryan, G. W., & Bernard, H. R. (2003). Techniques to identify themes. Field Methods, 15(1), 85–109. https://doi.org/10.1177/1525822X02239569
- Qasem, M., Ghaleb, M., Mahdi, H. S., Khateeb, A. A., & Fadda, H. A. (2023). Dialog chatbot as an interactive online tool in enhancing ESP vocabulary learning. Saudi Journal of Language Studies. Emerald Publishing Limited. https://doi.org/10.1108/SJLS-10-2022-0072
- Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.9
- Sadeghi, S. C. (2023). Artificial intelligence in technology-enhanced assessment: A survey of machine learning. Journal of Educational Technology Systems, 51(3), 372–386. https://doi.org/10.1177/00472395221138791
- Saini, M., & Shlonsky, A. (2012). Systematic synthesis of qualitative research. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195387216.001.0001
- Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. https://doi.org/10.3390/healthcare11060887
- Sallam, M. (2023). The utility of ChatGPT as an example of large language models in healthcare education, research, and practice: Systematic review on the future perspectives and potential limitations. MedRxiv, 2023-02. http://dx.doi.org/10.1101/2023.02.19.23286155
- Sheikh, I., & Price, L. (2023, January 30). University responds to emergence of ChatGPT in education. The Observer (MLA 9th Edition) UWIRE Text, p. 1. https://ndsmcobserver.com/2023/01/university-responds-to-emergence-of-chatgpt-in-education
- Sinha, R. K., Deb Roy, A., Kumar, N., et al. (2023, February 20). Applicability of ChatGPT in assisting to solve higher order problems in pathology. Cureus, 15(2), e35237. https://doi.org/10.7759/cureus.35237
- Su, J., Ng, D. T., & Chu, S. K. W. (2023). Artificial intelligence (AI) literacy in early childhood education: The challenges and opportunities. Computers and Education: Artificial Intelligence, 4, 100124. https://doi.org/10.1016/j.caeai.2023.100124
- Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments. https://doi.org/10.1186/s40561-023-00237-x
- Topal, A. D., Eren, C. D., & Geçer, A. K. (2021). Chatbot application in a 5th grade science course. Education and Information Technologies, 26, 6241–6265. https://doi.org/10.1007/s10639-021-10627-8
- Toraco, R. J. (2016). Writing integrative literature reviews: Using the past and present to explore the future. Human Resource Development Review, 15(4), 404–428. https://doi.org/10.1177/1534484316671606
- Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021). Are we there yet? A systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4, 654924. https://doi.org/10.3389/frai.2021.654924
- Zou, L., Wang, Q., & Zhao, P. (2019). A preliminary study on the application of artificial intelligence technology in meteorological education and training. In Proceedings of WI '19: IEEE/WIC/ACM International Conference on Web Intelligence (WI '19 Companion).