Prepare a clean camera and audio signal.

Release matrix / current browsers

Use the browser that belongs to your device.

Gesture Synth is continuously tested in Chromium and WebKit, the engine behind Safari. The instrument intentionally avoids browser extensions and plug-ins. Keep the browser updated, then use the matrix below as a practical starting point.

Chrome / desktop

Recommended

Full camera, audio, Worker, and WebGL path on Windows, macOS, ChromeOS, and Linux.

Edge / desktop

Recommended

Uses the Chromium engine and should follow the same primary path as Chrome.

Safari / macOS

Supported

Use a current Safari release and allow camera access for the site when prompted.

Safari / iPhone + iPad

Supported

Best with the device on a stable surface, a well-lit subject, and few other active tabs.

Chrome / Android

Supported

Tracking quality varies with processor, camera, heat, and power-saving settings.

Firefox

Not release-tested

The required APIs may be present, but Firefox is not part of the current compatibility gate.

In-app browsers

Avoid

Social and messaging app browsers can restrict camera or audio. Open the link in Safari, Chrome, or Edge.

“Supported” means the required browser path is covered by the release test matrix. It cannot guarantee a fixed frame rate on every camera-equipped device.

Required capabilities / no installation

The instrument checks five browser capabilities.

Camera access through getUserMedia() requires a secure context. That means the production site must load over HTTPS; local development also works on localhost. The browser must then support Web Audio, Workers, and image-frame transfer.

WebGL improves the camera treatment and performance visuals but is not required for basic sound. If the graphics layer cannot initialize, Gesture Synth can fall back to the normal video view.

Phone and tablet / stable framing

Mobile works best when the device stays still.

Gesture Synth adapts to portrait and landscape cameras, but hand tracking still needs a stable, complete view. Prop the phone against a solid object or use a stand. Leave enough distance for the wrist and all fingertips to remain inside the camera frame.

Portrait

Portrait gives you more vertical tone range and is natural for a phone. Move with smaller horizontal gestures because the pitch field is narrower.

Landscape

Landscape gives each note zone more physical width and makes two-hand harmony easier. Keep browser controls collapsed when possible so the instrument receives the largest viewport.

Audio output

Start at a moderate volume. Wired headphones, device speakers, and low-latency wireless audio all work, but some Bluetooth devices add noticeable delay outside the browser's control.

Camera access / user-controlled

Permission is requested only after Start.

The browser shows its own permission prompt after you select Start Gesture Synth. Choose Allow for the camera. The request asks for video only; if you see a microphone request, it is not coming from this application.

If you previously chose Block, use the camera or site-settings icon near the address bar to change the decision, then reload the page. On Safari, camera permission is managed in the website settings for the current site.

Real-time load / keep headroom

Camera vision, graphics, and audio share one device.

Close other tabs that use the camera, heavy graphics, or video conferencing. Connect mobile devices to power for longer sessions and disable aggressive low-power mode if tracking becomes inconsistent.

Gesture Synth monitors visual frame timing and can reduce rendering quality before changing the musical control path. A lower visual tier is not an error; it is how the instrument protects response on a busy or warm device.

1. Free the cameraClose meeting, recording, or camera applications before starting.
2. Reduce competitionClose graphics-heavy tabs and background apps.
3. Improve the lightBetter light lets the camera use cleaner, faster frames.
4. Reload onceAfter changing permissions or freeing the camera, reload and start again.

Compatibility questions / direct answers

Before opening the camera.

If your setup meets these requirements but does not start, follow the ordered Gesture Synth troubleshooting guide.