A Vocabulary Acquisition Learning System with Sand-Based Gamified Tangible Interface

Natanson, Hadar; Liu, Shih-Ta; Hsu, Su-Chu. (2025). A Vocabulary Acquisition Learning System with Sand-Based Gamified Tangible Interface. 14th EAI International Conference: ArtsIT, Interactivity & Game Creation (ArtsIT 2025).

作者:Hadar Natanson, Shih-Ta Liu, Su-Chu Hsu

摘要:We present an interactive installation that supports vocabulary learning through tangible play, combining physical interaction with AI and image processing technologies. Designed for children in rural Taiwan, the project reflects the University Social Responsibility (USR) initiative and aligns with Sustainable Development Goals 4 and 10. The system consists of two interconnected components: a playground surface, which serves as the interactive medium, and a game console, which provides game controls and sound management. Children engage with the system by manipulating sand on the playground surface, triggering vocabulary-related tasks and responses. AI-generated questions and real-time image processing enable dynamic, responsive interactions that encourage curiosity and self-guided learning. Communication between devices is managed through MQTT. The installation was deployed and tested at Shakeng Elementary School, where students explored the system in a guided session; feedback showed high levels of satisfaction and engagement.

關鍵字:Vocabulary Acquisition, Tangible Interface, Gamified Learning, AI Image Processing, Sand-Based Interaction, USR, Rural Education, MQTT

原始論文 DOI: https://doi.org/10.1007/978-3-032-26996-6_6