Enter the TensorFlow Microcontrollers Challenge for a chance to win $2500, get featured on Google channels, and more.

Semi-Conductor

December 2018 | By Google Creative Lab

Conduct your own orchestra in the browser by moving your arms

Collection:

Video Play Button

Semi-Conductor is an experiment that lets you conduct your own orchestra through your browser. You can move your arms to change the tempo, volume, and instrumentation of a piece of music. It uses PoseNet, a machine learning library that works in the browser, to map out your movements through your webcam. An algorithm plays along to the score as you conduct, using hundreds of tiny audio files from live recorded instruments.


Built by Rupert Parry, Melissa Lu, Haylie Craig and Samantha Cordingley from Google Creative Lab, Sydney.

Built with:

Submitting...
Saving...