The Visual Microphone: Extracting Sound from Visual Vibrations

Until now if you wanted to record a sound in the physical world you would most probably use a microphone. Now however, a research team partly funded by Adobe, MIT and Microsoft have developed a process that allows the capture of sound from videos that do not already feature any accompanying audio recordings.

The process revolves around the idea that when sound is emitted it causes nearby surfaces and materials to vibrate in sympathy with the frequency of the sound. When vibrating a material the sound effectively becomes visual and can be captured on film. Have a look at the video below to see the results for yourself.

The project and all accompanying examples, publications and code can be found here.

Advertisements