GESTURE SYNTHOpen instrument

Guided melody mode

Play a guided melody with finger cues.

Choose a song, learn its finger changes in Practice, then play a timed Quest run for score, accuracy, and combo.

How a run works

Follow the cues to play the melody.

Each song stores its own notes, timing, and note lengths. The large one-to-five cue tells you which finger count to show for the next note, so you can play the melody without learning a keyboard layout.

Practice can start immediately and wait for the first correct cue. Ranked Quest enters a ready state first: the countdown begins only after one hand has remained visible long enough for stable tracking. That hand becomes the lead hand and other hands stay silent. If tracking is lost or the inference loop stalls, the song clock pauses and resumes when the hand returns.

Fastest route

Choose a familiar Starter melody, learn its first few changes in Practice, then switch to Quest for timing and accuracy.

Choose a mode

Practice waits. Quest keeps time.

Practice
Learn without a timer
After the count-in, each note waits for the correct gesture. Wrong shapes stay silent, and the run does not save a score or rank.
Quest
Play to the beat
The song continues on time. A correct gesture earns PERFECT or GOOD; a wrong or late gesture becomes a MISS and resets the combo.
Repeated notes
Hold or re-articulate
Keeping the same shape triggers HOLD ASSIST so the phrase stays musical. Release and re-form the shape when that beat should add score, accuracy, and combo.
Results
Saved on this device
Quest shows score, accuracy, and longest combo. A 70% accuracy run clears the song, 90% masters it, and 100% with a full combo earns Full Combo.

Read the cues

Read the large cue first.

SHOW marks the opening target. CHANGE TO asks for a newly confirmed number, while HOLD means the current shape may remain in place for the next repeated event. Smaller tiles preview what comes later so you can prepare without moving early.

Keep each new shape steady until it is confirmed. Quest allows for the brief recognition delay when judging your timing.

SHOW / 1CHANGE / 2HOLD / 2CHANGE / 4HOLD / 4

Failure feedback and progress

A miss explains what happened and what comes next.

The full-song bar shows the current cue and total cue count. A separate timing bar fills across the actual gap before the next note, including long two- or four-beat holds. Before the first judged gesture, accuracy appears as a dash rather than an artificial 100%.

A wrong shape reports the number the camera saw. A late cue reports the missed number, and both messages show the next target so the player does not move backward after the chart has advanced. A large MISS flash makes the failure visible on a phone without adding an incorrect musical note.

WRONG SHAPE
Re-form the next target
The camera saw a stable number that did not match the cue. Read NEXT before changing the hand.
TOO LATE
Stay with the song
The timing window closed. Do not return to the consumed cue; prepare the displayed next number.
TRACKING PAUSED
No hidden penalty
The game clock is frozen until a stable hand returns to the frame.
HOLD ASSIST
Music without free score
The repeated note sounds, but a held pose does not inflate ranked combo or accuracy.

Choose a song

Start with music you already recognize.

The library includes Starter melodies, featured lyrical pieces, traditional folk songs, seasonal pieces, and classical themes. Current songs last about 11 to 30 seconds and use one complete melody phrase instead of repeating a short motif only to fill time.

Use the playable song library to compare difficulty, origin, approximate duration, and recommended voice. Use Listen to phrase before playing when the title is familiar but the selected excerpt is not.

Start playing

Learn the changes, then try a timed run.

Set the device on a stable surface, face a soft light, and keep your wrist and fingertips inside the camera view. Start in Practice if the changes are new. When the phrase feels predictable, choose Quest and aim for a cleaner timing grade or a higher local rank. A run must reach 70% accuracy and score above zero before it can create a shareable challenge.

Put a hand in the frame.

Play Gesture Synth