Freaky Deaky: Virtual Masks Projected Onto Faces In Real Time With Face-Tracking Projector

March 31, 2017


This is a video of a performance by Japanese dance duo AyaBambi using a 1,000-frame per second projector to add masks and crying black tear effects to their faces thanks to a very precise face-tracking system (previously: a similar system). An explanation while I paint my face like a clown because my roommate just watched the new It trailer and deserves to have a heart attack today:

The tiny glowing dots attached to the dancer's faces allow them to be tracked in real time so that the overlays created by the projector perfectly match their movements and facial expressions. The sensors require just milliseconds to process those movements, and then warp and distort the projected images to perfectly match them, which is fast enough to hide any delays from the human eye. So how long before we're all wearing projected clothing?

'How long until we're all wearing projected clothing?' I'm already wearing projected clothing! "You're naked." No, I'm actually fully clothed and just have a naked body projected onto me. "I stand corrected." Just kidding, I'm naked, get a good look.

Keep going for the video.

Thanks to barstool, hands down one of my favorite seats along with adirondack chairs, rocking chairs, and hammocks.

Previous Post
Next Post