Supported browsers
Start with a current Chrome, Edge, or Safari.
Gesture Synth is tested in Chromium browsers and WebKit, the engine used by Safari. It does not require a browser extension or plug-in. Keep the browser updated, then use the matrix below to check your device.
- Chrome / desktop
- Recommended
- Full camera, audio, Worker, and WebGL path on Windows, macOS, ChromeOS, and Linux.
- Edge / desktop
- Recommended
- Uses the Chromium engine and should follow the same primary path as Chrome.
- Safari / macOS
- Supported
- Use a current Safari release and allow camera access for the site when prompted.
- Safari / iPhone + iPad
- Supported
- Best with the device on a stable surface, a well-lit subject, and few other active tabs.
- Chrome / iPhone + iPad
- Supported
- Uses Apple's WebKit engine and follows the same camera restrictions as other iOS browsers.
- Chrome / Android
- Supported
- Tracking quality depends on the processor, camera, device temperature, available memory, and power-saving settings.
- Samsung Internet / Android
- Supported
- Uses Chromium and should behave similarly to Android Chrome. Prefer the latest release.
- Firefox
- Not release-tested
- The required features may be available, but Firefox is not included in the current release tests.
- In-app browsers
- Avoid
- Social and messaging app browsers can restrict camera or audio. Open the link in Safari, Chrome, or Edge.
“Supported” means the required browser path is covered by the release test matrix. It cannot guarantee a fixed frame rate on every camera-equipped device.
What the browser needs
The instrument checks five browser capabilities.
Camera access through getUserMedia() requires a secure context. That means the production site must load over HTTPS; local development also works on localhost. The browser must then support Web Audio, Workers, and image-frame transfer.
WebGL improves the camera treatment and performance visuals but is not required for basic sound. MediaRecorder and canvas capture are required only for video recording; Share additionally depends on the Web Share API and file-share support. The recording compatibility guide explains format selection, My Works storage, and download fallbacks.
No microphone. No MIDI device. No account. No app install. No cloud processing.
Phone and tablet setup
Mobile works best when the device stays still.
Gesture Synth adapts to portrait and landscape cameras, but hand tracking still needs a stable, complete view. Prop the phone against a solid object or use a stand. Leave enough distance for the wrist and all fingertips to remain inside the camera frame.
On phones and narrow portrait windows, the instrument asks for a wider camera view and avoids cropping the preview. You may see empty space around the camera image, but more of the wrist and fingertips remain visible.
Portrait
Portrait is natural for a phone and matches short-video output. Keep the performing hand near the middle so the trigger readout and five-count map remain visible.
Landscape
Landscape gives two hands more separation and creates a 16:9 recording. Keep browser controls collapsed when possible so the instrument receives the largest viewport.
Audio output
Start at a moderate volume. Wired headphones, device speakers, and low-latency wireless audio all work, but some Bluetooth devices add noticeable delay outside the browser's control.
Camera permission
Permission is requested only after Start.
The browser shows its own permission prompt after you select Start Gesture Synth. Choose Allow for the camera. The request asks for video only; if you see a microphone request, it is not coming from this application.
If you previously chose Block, use the camera or site-settings icon near the address bar to change the decision, then reload the page. On Safari, camera permission is managed in the website settings for the current site.
Performance
Close other camera and graphics-heavy apps.
Close other tabs that use the camera, heavy graphics, or video conferencing. Connect mobile devices to power for longer sessions and disable aggressive low-power mode if tracking becomes inconsistent.
Gesture Synth can simplify camera effects when the device is busy. The VISUAL label may change from full to reduced or fallback, but the finger-to-note mapping stays the same.
- Free the cameraClose meeting, recording, or camera applications before starting.
- Reduce competitionClose graphics-heavy tabs and background apps.
- Improve the lightBetter light lets the camera use cleaner, faster frames.
- Reload onceAfter changing permissions or freeing the camera, reload and start again.
Common compatibility questions
Before opening the camera.
Does Gesture Synth work on mobile?
Yes. Gesture Synth supports current Safari on iPhone and iPad and current Chrome on Android. Device speed, heat, available memory, and camera quality can affect tracking and visual performance.
Why does Gesture Synth require HTTPS?
Browsers expose camera access only in secure contexts such as HTTPS or localhost. The production site uses HTTPS so the browser can request camera permission safely.
Does Gesture Synth use the microphone?
No. The instrument requests video camera access only. Optional videos contain the locally synthesized audio bus, never microphone input.
Can every browser share a recorded video?
Recording format and file sharing depend on browser support. Gesture Synth tries MP4 and WebM encoders at runtime. Mobile system browsers commonly expose a share sheet; when file sharing is unavailable, save the video and upload it from the social app.
Which browser is recommended?
Use a current release of Chrome or Edge on desktop, Safari on Apple devices, or Chrome on Android. Embedded in-app browsers are less reliable; open the site in the device system browser.
If your setup meets these requirements but does not start, follow the ordered Gesture Synth troubleshooting guide.