Camera-powered instrument / No. 02
Gesture
Synth
Free Play puts melody on the right and harmony on the left. In Song Quest, either first hand can lead.
Start Gesture SynthLocal camera only. Records when you choose.
A camera-powered musical instrument
Your hands become the interface.
A gesture synth turns physical movement into electronic sound. This one runs entirely in your browser: no MIDI keyboard, plug-ins, installation, account, or previous musical experience required.
Show one to five clearly extended fingers and hold the shape for a fraction of a second. Index first is the simplest way through 1 to 4; a thumb by itself also counts as 1, while a full open palm is 5. A confirmation bar filters accidental transition shapes, then the instrument plays a tuned note or chord. Raise the hand for brightness; lower it to the bottom edge or make a deliberate fist to rest.
Nothing to memorize.
- 01Show 1–5 fingers
Choose a tuned sound
- 02Hold for confirmation
Ignore transition shapes
- 03Raise for brightness
Shape the tone
- 04Lower to rest
Release and re-arm
Same hand map, different bodies of sound
Choose a voice. Keep the gesture.
Switch among four designed synthesizer voices without leaving the stage. Every voice follows the same five finger shapes, while Output, Brightness, Space, Echo, Motion, key, octave, and musical role remain adjustable.
- 01AirglassFM synthesizer
Airglass is the default FM voice: glassy, responsive, and suited to melodic phrases.
- 02SoftpadAM pad
Softpad is a warm amplitude-modulation pad for held notes and soft harmony.
- 03PulsewirePulse lead
Pulsewire is a bright pulse lead that favors articulated hand gates and fast runs.
- 04VelvetPluck voice
Velvet is a muted pluck voice for sparse motifs and percussive hand gestures.
Airglass is the clearest first voice. Softpad favors sustained harmony, Pulsewire rewards rhythmic finger changes, and Velvet favors sparse plucked lines. Song Quest teaches complete melodies before you need music theory.
Private by construction
The camera stops at your screen.
Live video and hand landmarks are processed on your device. Recording begins only after your countdown; the finished file stays local until you save it or choose a destination in the system share sheet.
Before you raise a hand.
What is a gesture synth?
A gesture synth is an electronic instrument controlled through movement. Gesture Synth counts every clearly extended finger from one to five, maps each stable count to a tuned note or chord, and uses hand height for expression.
Which browser works best?
Use a current version of Chrome, Edge, or Safari on a camera-equipped phone, tablet, or computer. A well-lit space helps the hand tracker see cleanly.
Why do the notes and chords sound good together?
Melody mode uses the first five notes of a major scale. Chord mode maps the same shapes to I, vi, IV, V, and ii. Choose a key and every option remains harmonically related.
What instrument voices can I play?
Gesture Synth includes four finished voices on the same hand map: Airglass for glassy FM leads, Softpad for warmer held tones, Pulsewire for bright articulated phrases, and Velvet for soft plucked motifs.
Is my camera footage private?
Yes. Recognition happens locally in your browser. Video is created only when you press Record, stays on your device, and is shared only through your browser or operating system share sheet.
Can beginners play a complete song?
Yes. Song Quest lets either hand lead, shows current and upcoming finger counts, supports held repeated notes, scores timing with gesture-confirmation compensation, and includes six original five-note arrangements of public-domain melodies.
Go deeper without slowing the first note