Body Synth

October 2018 | By Use All Five & Google Creative Lab

Make music just by moving your body.

Collection:

Black and white web camera feed of woman raising arms slightly. Yellow lines are mapped over the her body and lines are squiggly, to indicate movement and sound.

Looping gif of a woman dancing with colorful lines mapped over her body. The lines animate as she moves

Looping gif of a woman raising her arms in front of a laptop. On the laptop screen, colorful lines are mapped over her body animate as she moves

This experiment turns your body movements into sound. Just turn on your webcam and move your body. Each part of your body plays a different note or sound. Note that your images are not being stored or sent to any Google servers while interacting with the experiment.

You can adjust the sensitivity to make it work for big or small movements. You can also change chords and instruments using your voice by saying things like “C chord” and “guitar.”

This experiment was made by Use All Five, Kyle Phillips, Claire Kearney-Volpe, Luisa Pereira, Yotam Mann, and Google Creative Lab. Special thanks to friends at Henry Viscardi School at The Viscardi Center, Tech Kids Unlimited, and ADAPT Community Network.

Built with:

Tensorflow.js, Tone.js, WebRTC, Web Speech API