Control VLC with your voice and gestures

3 May 2015


In VLC, we have hundreds of modules to do many crazy things, including karaoke or puzzle filter!

Today, I coded 2 nice features, using IntelĀ® RealSenseā„¢ technology: one is a voice control plugin for VLC, and the other is a gestures control plugin for VLC.

With the voice control plugin, you can ask VLC to play, pause, stop, just with voice commands, like in 2001: a space Odyssey.

With the gestures one, you can move your hands before the 3D camera, a la minority report.



You can find the Windows binary for VLC 2.2.1 (should work in all 2.2.x versions) here:

You need to install them in the plugins/control folder in your VLC installation (usually in C:\Program Files (x86)\VideoLAN\VLC) and restart VLC.

You need to have RealSense runtime installed too, if you don’t have it.

Finally, you need to activate them in the preferences. (advanced -> Interface -> Control Interfaces).



Of course, I provide, the source of the plugin here, so you can hack on it, and recompile it.

To build it, you need the latest version of the RealSense SDK, with a version above 4, and you need to point to the right headers. Here is another patch to help you build it, if you need.



The voice module should understand the following control:

  • “Play”
  • “Pause”
  • “Stop”
  • “Next”
  • “Previous”
  • “Volume Up”
  • “Volume Down”


The gestures recognized should be:

  • waving to stop
  • swiping to go to the next video
  • “V sign” to go to the previous video
  • tap in front of the camera to toggle play/pause
  • “Thumb Up” to increase the volume
  • “Thumb Down” to decrease the volume
  • “Full Hand Pinch” to mute the sound''

Have fun!

Jean-Baptiste Kempf