Interactive music guide
Gesture Synth Weld Vercel App: Webcam Synth Guide
Play Gesture Synth Weld with webcam hand tracking. Learn how gestures control chords, tone, octave, pitch, and the camera permission boundary.
Independent guide: ToolAtrium does not operate Gesture Synth and did not audit its camera-frame handling, storage, analytics, or future revisions. Grant camera access only when you understand the browser prompt and the current site policy.
Gesture Synth Weld at a glance
- Format
- Interactive browser music instrument
- Input
- Webcam hand tracking via MediaPipe
- Sound
- Web Audio synth with selectable tones
- Modes
- Two-handed or left-hand-only play
- Permission
- Camera access is required to play
Quick verdict
The Gesture Synth Weld Vercel app turns hand position and finger patterns into a playable browser instrument. Its appeal is the direct mapping from gestures to harmony and expression; its main consideration is the camera permission required before the instrument can start.
What is the Gesture Synth Weld Vercel app?
Gesture Synth is an interactive musical instrument created by Eric Wei. The public page presents a camera view, a chord display, a key selector, tone presets, a play flow, and a guide explaining how hand gestures become sound.
The app is designed for instant experimentation rather than a conventional DAW. Choose a chromatic root from A through G#/Ab, pick a tone, allow the camera, and move your hands in front of the webcam to explore chords, melodies, and filter changes.
How the hand gestures shape music
The left hand selects harmony. Tilting inward chooses a major quality and tilting outward chooses minor. Finger combinations select scale degrees I through VII: one to five fingers map to I through V, index plus pinky maps to VI, and index plus pinky plus thumb maps to VII.
The right hand changes the voicing and expression. One to four fingers select root position, first inversion, a seventh quality, or a dominant/diminished seventh. Thumb position changes the octave, hand height changes volume, and inward or outward tilt changes the filter.
- Use left-hand tilt for major or minor color.
- Use left-hand finger patterns for scale degrees.
- Use right-hand fingers for chord voicing.
- Move the right hand higher for louder sound and tilt it to sweep the filter.
Key, tone, and pitch-shift controls
The key selector exposes twelve chromatic roots: A, A#/Bb, B, C, C#/Db, D, D#/Eb, E, F, F#/Gb, G, and G#/Ab. Tone presets include Warm Synth, Bright Synth, Retro Synth, Strings, and Horns, so the same gesture vocabulary can feel soft, crisp, vintage, orchestral, or brass-like.
The guide also offers Two-Handed and Left Hand Only modes. When pitch shift is enabled, moving the left hand into the top 50% raises the chord by one semitone, the middle 30% keeps it normal, and the bottom 20% lowers it by one semitone.
Camera permission and privacy boundary
The landing page says camera access is required to play, and the delivered JavaScript requests a 640×480 video stream with audio disabled before loading the hand-tracking pipeline. The public build also loads MediaPipe Tasks Vision from jsDelivr and creates audio with the browser Web Audio API.
Those observations explain the runtime path, but they do not prove how every camera frame is retained or whether future builds will behave the same way. Before using the instrument in a classroom, performance, or shared device, read the current browser permission prompt and the project’s privacy terms.
Gesture Synth Weld Vercel app FAQ
Does Gesture Synth Weld need a webcam?
Yes. The landing page says camera access is required to play, and the public JavaScript requests a video stream.
What can the left hand control?
Left-hand tilt changes major or minor quality, while finger combinations select scale degrees I through VII. The guide also describes optional pitch shifting by hand height.
What does the right hand control?
Right-hand fingers change chord voicing, the thumb changes octave, height changes loudness, and tilt changes the filter.
Which tones are available?
The visible selector includes Warm Synth, Bright Synth, Retro Synth, Strings, and Horns.
Does ToolAtrium verify camera storage?
No. ToolAtrium verified the visible permission flow and public script behavior, but did not independently audit retention, analytics, or future revisions.
Continue on ToolAtrium