Professor Han Ping-Hsuan and his Tean won the Best in Show Award at the 2023 ACM SIGGRAPH
 

The National Taipei University of Technology's Interactive Design Department, led by Professor Han Ping-Hsuan, achieved the "Best in Show Award" in the "Immersive Experience" category at the 2023 ACM SIGGRAPH Computer Animation Exhibition. Their Extended Reality (XR) creation, "Actualities," captivated audiences by synchronizing live musical performances with vibrations, creating an interactive multiverse concert. Competing against entries from the United States, the United Kingdom, Japan, and Taiwan, NTUT stood out in this prestigious global competition.

The SIGGRAPH Computer Animation Exhibition, a landmark event in the digital media and interactive technology fields, celebrated its 50th year in Los Angeles, USA, attracting over 78 countries and tens of thousands of industry professionals and academic representatives. The NTUT team's innovative project showcased the potential of immersive experiences, combining complex interactions seamlessly accessible to users without the need for extensive learning.

"Actualities," conceived by NTUT's Interactive Design Department's graduate students Lin Ke-Fan, Zhou Yu-Zhi, Weng Yu-Hsiang, international program student Chen Yi-Xuan, Lin Jing-Ying, and Assistant Professor Han Ping-Hsuan, went through a year-long creative process. As the guitarist played, flowers blossomed, and butterflies danced in response; a beat on the wooden drum triggered instant fireworks synchronized with the rhythm. Stepping into the rock zone, the audience transformed into "little demons," and online viewers could choose different virtual avatars, sending symbols like hearts and stars to the performers.

Zhou Yu-Zhi explained the utilization of optical and capacitive sensors to capture live performance data, triggering various effects. The transformed digital version in the virtual world offered viewers a multidimensional experience during live performances, turning concerts into collaborative artistic feasts.

Professor Han Ping-Hsuan highlighted the project's origin in a collaborative case with a company last year. The XR Lab, under his leadership, developed music visualization software and incorporated XR streaming technology. Collaborating with a local band, they aimed to create a novel experience, allowing both remote and live audiences to actively participate in a concert, resembling a multi-universe crossover.

During the SIGGRAPH exhibition, NTUT's "Actualities" attracted numerous international visitors. The judging panel praised the project for seamlessly integrating highly complex interactions, providing an easy-to-experience yet enjoyable encounter that embodied the core concept of the Immersive Experience category, bringing innovation to immersive interactions.

Original News Article: Link to Liberty Times News

Short Introduction Video: YouTube Link