Harnessing AI, Data Science, IoT, and the Metaverse: Revolutionising Integrated STEAM Education and Meta-Commerce

The next generation of the internet is here, integrating AI, Data Science, IoT, and the Metaverse to enhance learning, social interactions, and commercial activities. Since 2022, the Data Science Lab at HKU Department of Statistics and Actuarial Science, School of Computing and Data Science (SAAS DSL) has collaborated with Marvel Digital Ai Limited on an “AI in Metaverse project,” developing an AI app for emotion detection via text, speech, and video to improve human-like communication in the Metaverse of HKU Campusland.

In 2023, SAAS DSL built connections with 11 schools, developing exhibition rooms, an AI chatbot, 3D visualisation, and mixed reality learning content with teachers and students. This initiative involved 100 undergraduate students from universities worldwide in the “We Together in Metaverse” project for integrated STEAM education. The meta-innovation school campus at HKU Campusland opened on October 6, 2023.  An applied research publication on the company case using 3D visualisation of HKU Campusland was accepted for publication in Fall 2024.

Looking ahead to 2024, the emotional AI chatbot will be further developed for customer enquiries, virtual internships, and virtual entrepreneurship. This initiative aims to nurture students in commercial knowledge, innovation, applied learning, and business communications through the “We Innovate Together in Metaverse project.” Dr Adela LAU, Deputy Director of HKU SAAS Data Science Lab, stated, ‘SAAS DSL will teach students to use apps developed by HKU SAAS DSL for emotion detection, social media/big data analysis, and mixed reality analysis, and deploy them to build a meta-commerce environment for meta-integrated STEAM education and meta-business models.’ In addition, two new HKU startups, Thinkify Technology Ltd and Dr Adela Education Ltd, were established and joint ventured with Marvel Digital Ai Ltd respectively to support HKU’s teaching for innovation.

Currently, 11 local and overseas companies (Hong Kong, Singapore, UK, Ireland, USA, South Africa) are participating in this project, offering virtual entrepreneurship and internships to local and worldwide students. More AI chatbots and integrated STEAM learning courses will be implemented in collaboration with companies and schools. Professor Eddy LAM, Associate Head of HKU SAAS and Associate Dean (Student Affairs) of the Faculty of Science, explained, ‘The project aims to foster students' application of STEAM theories in practical settings, enhance their understanding of the diverse nature of industries, develop metaverse business models, and promote digital economy and innovation on a global scale.’

Dr Adela Lau added, ‘All local and overseas companies and schools are welcome to participate in the “We Innovate Together in Metaverse project” with Dr Adela Lau to build their schools, business models, and metaverse buildings in HKU Campusland together.’  In 2025, our metaverse project will extend to ‘Technology Innovation Leadership in Metaverse’ for deploying our innovations of the metaverse project for education, company training and business.