Theater of Future Puppetry:
Immersive Real-Time Puppeteer System
未來布袋戲劇場 - 沉浸式即時操偶系統
一套結合VR手勢辨識、多人即時手機操偶與傳統台灣布袋戲的沉浸式表演系統。讓觀眾以新的方式體驗和互動傳統布袋戲並同時推動文化保存。
An immersive performance system combining VR gesture recognition, real-time multi-user mobile puppetry, and traditional Taiwanese glove puppetry. It allows audiences to experience and interact with traditional puppetry in a new way while promoting cultural preservation.
沉浸式空間 + 頭戴式虛擬實境 + 舞蹈演出
———————————————————————
VR手勢辨識結合當代舞蹈：現代舞者透過配戴VR頭盔，配合即時手勢辨識結合當代舞蹈演出，我們創造了一個獨特的藝術表演平台，並將經典布袋戲角色“旦”融入在演出中與舞者即時互動，實現物理和數位表演的無縫結合。通過即時的沈浸式畫面呈現，觀眾能非常直接觀察到戲偶內部傳統手勢運動軌跡的細節之美與技藝。
Immersive Space + HMD VR + Dance Performance
———————————————————————
VR Gesture Recognition Combined with Contemporary Dance: Modern dancers, wearing VR headsets, perform contemporary dance integrated with real-time gesture recognition. We have created a unique artistic performance platform, incorporating the classic character "Dan" from traditional Taiwanese puppetry into the performance to interact with the dancers in real-time, achieving a seamless blend of physical and digital performances. Through immersive real-time visuals, the audience can directly observe the intricate beauty and craftsmanship of the traditional hand gesture movements inside the puppets.
頭戴式虛擬實境 + 操偶
———————————————————————
虛擬實境操偶體驗：一套觀眾可以直接在虛擬環境中體驗傳統布袋戲手勢的遊玩系統。在虛擬實境中提供五種經典布袋戲角色體驗分別為：生（男）、旦（女）、淨（武將）、丑（丑角）和雜（獸），透過Oculus Quest 2 手部追踪系統捕捉用戶的手部和手指動作，將其轉換為對應的戲偶動作，實現精確控制和自然的互動體驗，每個手勢都經過仔細分析和數位化處理，以重現台灣傳統布袋戲的精細手部動作和文化意義。
HMD VR + Puppeteer
———————————————————————
Virtual Reality Puppet Experience: A system that allows the audience to directly experience traditional Taiwanese puppetry gestures in a virtual environment. In this VR experience, users can interact with five classic puppet characters: Sheng (Male), Dan (Female), Jing (Military General), Chou (Clown), and Za (Beast). Using the Oculus Quest’s hand tracking system, the user's hand and finger movements are captured and translated into corresponding puppet actions, enabling precise control and a natural interactive experience. Each gesture has been carefully analyzed and digitized to faithfully reproduce the intricate hand movements and cultural significance of traditional Taiwanese puppetry.
沉浸式空間 + 多人即時手機操偶
———————————————————————
提供多個使用者能夠通過手機同時即時控制戲偶，使用者透過掃描投影牆上特定的 QR 碼，選擇欲操控的虛擬戲偶。虛擬戲偶根據角色性格分成生、旦、淨、丑、雜，共五隻不同外觀的虛擬戲偶。在體驗中不同操控者之虛擬戲偶之間可以進行互動，提供用戶更多的互動性和參與感。
Immersive Space + Multi-Users
———————————————————————
This system allows multiple users to simultaneously control virtual puppets in real-time using their mobile phone. Users can scan specific QR codes projected on a wall to select the virtual puppet they wish to control. The virtual puppets are divided into five distinct characters based on their personalities: Sheng, Dan, Jing, Chou, and Za, each with a unique appearance. During the experience, the virtual puppets controlled by different users can interact with one another, enhancing the level of interactivity and engagement for participants.
沉浸式空間 + 機械手臂 + 舞蹈演出
———————————————————————
表演者透過穿戴動作捕捉手套，將布袋戲精緻的手部動作數據即時傳送，控制機械手臂與機械偶，並與其共舞。透過動態補捉手套紀錄操偶的手部動作，再把動態資料傳輸給機械偶，使操偶的動作可以即時展現，又能將此數據紀錄保存進行非即時的再現，作品藉由創新的科技，將傳統文化於另一形式保存。
Immersive Space + Robotic Arm + Dance Performance
———————————————————————
The performer uses motion capture gloves to transmit the intricate hand movements of traditional puppetry in real-time, controlling a robotic arm and a mechanical puppet, and dancing with them. The motion capture gloves record the hand movements used in puppetry, then transmit this motion data to the mechanical puppet, allowing the puppeteer's actions to be displayed in real-time. Additionally, this data can be recorded and preserved for non-real-time reproduction. Through innovative technology, the work preserves traditional culture in a new form.
