Tchaikovsky Museum
Tchaikovsky Museum
Back
Tchaikovsky museum
Immersive • XR/AR
Date
2019
Info
Visitors become conductors and lead a virtual orchestra in real time using baton movements. Sensors detect rhythm and speed, while illuminated instruments respond to the performance. It’s an educational and enchanting way to connect with Tchaikovsky’s music and the art of conducting.
My role
I designed the interactive stand, animations, and gameplay interface.
To achieve realistic motion, we filmed the Helikon-Opera orchestra and consulted professional conductors. All pieces used in the installation were performed and recorded specifically for the installation, allowing visitors to conduct real orchestral parts. The orchestra even reacts to how accurately the visitor conducts.
Idle
level_selection
notes
score_screen
Stage 2
After further consulting with a professional conductor, we refined the mechanics so the baton gestures more closely match.
Functionality
A visitor stands at the conductor’s panel, selects a composition, and sees the orchestra projected onto a large surface. The system tracks baton movement and tempo, lighting instruments as their parts play. Around the installation, illuminated figures mark sections of the quartet. At the end, the visitor sees their conducting result on the projection screen.
