Momo
An interactive hand-tracking game and photo box for the lobby of a Momo theatre production.
details
Momo was a student project for the Mezzanin Theater in Graz, Austria: an interactive lobby setup for their production of Momo (the children’s book by Michael Ende, I love that story btw). Five students of the University of Applied Sciences Salzburg, including me, built a hand-tracking mini-game and a photo box.
game
In the hand-tracking mini-game the players’ hands are tracked and water sprays from the palms of their virtual hands. Players aim the water to destroy Grey Men and reach a highscore; with increasing score, phrases from the book appear on screen.
Hand tracking uses Google MediaPipe, running from Unity with the data points visualised in the scene. The water is simulated with the Zibra Liquid package and the sound design was done in fmod.
I implemented the MediaPipe hand tracking, the scoring system, the configurable book quotes unlocked by score, the highscore saving and the fmod integration.
photo box
The photo box ran on a Raspberry Pi with a webcam. A Python script used face detection to trigger the shutter, and the photos of theatre guests were exported to USB and used in the play itself. My part was bugfixing and getting everything to run on the Raspberry Pi.
team
- David Märzendorfer: Hand-tracking, scoring & fmod integration
- Jessica Kremnitzer: Photobox creation
- Dorothée Sachsenhofer: Audio asset creation
- Nico Weiser: Gamedesign & water simulation
- Mirjam Kuchling: UI & concept art
