Reconstructing the Experience of Nüshu Culture: An Exploration via Multimodal Mixed Reality Systems

摘要

Nüshu (Jiangyong Nüshu), a script developed and practiced exclusively by women in China, holds recognition as National Intangible Cultural Heritage. This paper presents the design and implementation of an immersive multimodal interaction system centered on The Song of Nüshu, a foundational cultural artifact. By integrating Natural Interaction (NI) and Mixed Reality (MR) technologies, the system constructs a visual environment inspired by classical Chinese landscape painting aesthetics. Within this experiential space, users engage with representations of pivotal female historical figures and events interwoven with Nüshu textual elements. This framework enables participant-driven narrative construction that foregrounds Nüshu's aesthetic dimensions and socio-cultural significance. Our work advances a heritage preservation methodology that innovatively reinterprets tradition while explicitly foregrounding women's historical agency and expressive practices.