Sampler

October 2018 | By Use All Five & Google Creative Lab

A simple musical sampler you can play with your face, body, mouse or keys.

Collection:

woman has a cursor mapped to her nose that is hovering over one of four colorful circles on screen

Animated gif of woman with a cursor mapped to her nose, as she rotates her head the cursor moves over four colorful circles on screen

Screencap of Sampler interface. The left hand menu contains a variety of presets and controls. In the main play area, two of four colorful circles have soundwaves mapped over them.

This is a musical sampler that can be triggered in different ways. You can use your mouse and keyboard. Or, turn on your webcam and track a point on your body, like your nose. Note that your images are not being stored or sent to any Google servers while interacting with the experiment.

You can also import your own samples. And, you can control other instruments using MIDI. Just connect a MIDI device and select it in the MIDI Out dropdown.

This experiment was made by Use All Five, Kyle Phillips, Claire Kearney-Volpe, Luisa Pereira, Yotam Mann, and Google Creative Lab. Special thanks to friends at Henry Viscardi School at The Viscardi Center, Tech Kids Unlimited, and ADAPT Community Network.

Music by Blake Straus, Alek Fin, Dylan Meek, Roland Gajate Garcia, DD Horns, Morgan Paros, Andrew Synowiec, Corbin Jones, Alison Balbag, Ian Mallitz, Daniel Braunstein, Christopher Dwyer, Zac Sager, Mashadi Maximus.

Built with:

Tensorflow.js, Tone.js, WebRTC