HandsON Music
A browser based interaction demo that uses hand tracking to control music playback and trigger rhythm sounds. The goal is to turn simple gestures into a lightweight audio control layer.
How the Demo Works
HandsON Music turns hand movements into a small audio control interface. The right hand handles playback actions such as play, pause, track navigation, and volume. The left hand adds rhythm triggers, so the interaction feels closer to a gesture based performance tool than a standard media player.
Left Hand · Rhythm Layer
The left hand adds rhythm sounds on top of the music player.
- Thumb + index tip => Cymbal 1
- Thumb + middle tip => Cymbal 2
- Thumb + ring tip => Kick
- Rhythm gestures => simple gesture based drum pad
Right Hand · Playback Control
The right hand controls playback. Fingertip contact triggers actions. Volume is controlled with a stable hand pose.
- Thumb + index tip => Play
- Thumb + middle tip => Pause
- Thumb + ring tip => Next track
- Thumb + pinky tip => Previous track
- Volume mode => fold ring and pinky into the palm
- Set volume => distance between thumb and index middle pair
Tip: allow camera access and enable sound first. Gesture detection works best when the hand is clearly visible and the background is not too noisy.