Immersive Space + HMD VR + Dance Performance

———————————————————————

VR Gesture Recognition Combined with Contemporary Dance: Modern dancers, wearing VR headsets, perform contemporary dance integrated with real-time gesture recognition. We have created a unique artistic performance platform, incorporating the classic character "Dan" from traditional Taiwanese puppetry into the performance to interact with the dancers in real-time, achieving a seamless blend of physical and digital performances. Through immersive real-time visuals, the audience can directly observe the intricate beauty and craftsmanship of the traditional hand gesture movements inside the puppets.

HMD VR + Puppeteer

———————————————————————

Virtual Reality Puppet Experience: A system that allows the audience to directly experience traditional Taiwanese puppetry gestures in a virtual environment. In this VR experience, users can interact with five classic puppet characters: Sheng (Male), Dan (Female), Jing (Military General), Chou (Clown), and Za (Beast). Using the Oculus Quest’s hand tracking system, the user's hand and finger movements are captured and translated into corresponding puppet actions, enabling precise control and a natural interactive experience. Each gesture has been carefully analyzed and digitized to faithfully reproduce the intricate hand movements and cultural significance of traditional Taiwanese puppetry.

Immersive Space + Multi-Users

———————————————————————

This system allows multiple users to simultaneously control virtual puppets in real-time using their mobile phone. Users can scan specific QR codes projected on a wall to select the virtual puppet they wish to control. The virtual puppets are divided into five distinct characters based on their personalities: Sheng, Dan, Jing, Chou, and Za, each with a unique appearance. During the experience, the virtual puppets controlled by different users can interact with one another, enhancing the level of interactivity and engagement for participants.

Immersive Space + Robotic Arm + Dance Performance

———————————————————————

The performer uses motion capture gloves to transmit the intricate hand movements of traditional puppetry in real-time, controlling a robotic arm and a mechanical puppet, and dancing with them. The motion capture gloves record the hand movements used in puppetry, then transmit this motion data to the mechanical puppet, allowing the puppeteer's actions to be displayed in real-time. Additionally, this data can be recorded and preserved for non-real-time reproduction. Through innovative technology, the work preserves traditional culture in a new form.