Tchaikovsky museum
Tchaikovsky museum
Back
Tchaikovsky museum
Immersive • XR/AR
Date
2019
Info
Visitors become conductors and lead a virtual orchestra with real-time baton movements. Sensors detect rhythm and speed, while illuminated instruments augment the scene. It’s an educational and enchanting way to connect with Tchaikovsky’s music and the conductor’s craft.
What did I do
I designed the interactive stand, animation, and gameplay interface.
To achieve realistic motion we filmed the Helikon-Opera orchestra and consulted professional conductors. All pieces used in the installation were performed and recorded so visitors could conduct them; the orchestra even reacts to how well the “conductor” performs.
Idle
level_selection
notes
score_screen
Stage 2
After further consulting with a professional conductor, we refined the mechanics so baton gestures closely match real conducting motion.
Functionality
A visitor stands at the conductor’s panel, selects a composition, and sees the orchestra’s projection on a large surface. The system tracks baton movement and tempo, lighting instruments as their parts play. Around the installation, illuminated figures mark sections of the quartet. At the end, the user sees their conducting result on the projection screen.
