Foley artists perform sounds like footsteps and cloth movement in sync with picture. Gesture Foley brings that performance to a webcam. An AI hand tracker follows your fingers, and touching your thumb to a fingertip plays a sound, so you can perform a whole foley pass in front of your screen without a pit full of props.
It runs in the browser with no install, or as a Python app that sends every touch as MIDI into a DAW like Reaper, where the performance can be edited like any foley recording. Ten sound folders, from footsteps, cloth and props to jewellery, creatures and cinematic hits, hold 143 sub-categories such as Wood › Stairs or Leather › Jacket, and you can drop your own recorded samples into any of them.
- Precise by design. Fingertips are smoothed with a One Euro filter, each touch plays once, and only the clearly closest finger can fire, so two sounds never trigger together.
- Blend pad. Each folder has an XY pad with a surface in every corner. Move the point, or steer it with your palm, and each hit mixes the four at an even loudness.
- Layer pad. A second pad plays with every hit from any folder: cloth under footsteps, keys and chains under horses, whooshes under cinematic hits.
- Size, mixer and templates. Size changes the character's weight, a mixer sets level, pan, mute, solo and room, and 22 templates such as Forest walk, Bar fight or Storm set it all in one click.
- Expressive. How fast your fingers close sets the velocity: a quick touch is a hard, running step.
- Next step. A JUCE plugin (VST3/AU) for Pro Tools and Reaper, with a recorded sample library.