Immersive inclusivity: AI-enhanced virtual reality for language and cultures learning

Abstract

Virtual Reality (VR) has emerged as a transformative tool, offering significant potential to enhance inclusivity. This paper examines the integration of VR and Artificial Intelligence (AI) in language and cultures learning, focusing on its application in fostering an inclusive and immersive educational experience. It presents AI-driven VR scenarios that transform language learning into an inclusive, immersive experience. The Unity-based experience enabled real-time spoken interaction by combining OpenAI’s Audio Transcriptions API (Whisper-1), the GPT-4o dialogue model, and AWS Polly for text-to-speech. A case study has been conducted with Spanish B2-level students who engaged in a VR job interview simulation within the Data Immersion Suite. This platform provided an interactive environment for students to practice real-world communication while receiving peer feedback. Given that higher-level language acquisition demands not only grammatical accuracy but also real-world communicative competence, VR offers a dynamic solution by simulating authentic interactions in a low-pressure setting. The combination of VR and AI created a customisable and accessible learning platform, accommodating varied learning paces and reducing social anxiety. The effectiveness of VR and AI as tools for inclusive, immersive learning is further supported by existing research indicating that multisensory engagement enhances retention (Shadiev et al., 2021). These pedagogical innovative sessions provide valuable insights for developing innovative and inclusive approaches aligning with contemporary pedagogical demands while increasing the appeal of our academic offerings in the context of CTP.