This is a technical demo for face substitution technique. The application works in real time and it’s developed using the opensource framework for creative coding openFrameworks: http://openFrameworks.cc
Most of the “magic” happens thanks to Jason Saragih’s c++ library for face tracking http://web.mac.com/jsaragih/FaceTracker/FaceTracker.html. The face tracking library returns a mesh that matches the contour of the eyes, nose, mouth and other facial features.
That way the mesh obtained from a photo is matched to my own face in the video. Applying some color interpolation algorithms from Kevin Atkinson’s image clone code: http://methodart.blogspot.com/ gives it the blending effect that can be seen in the final footage.
I’m also using Kyle McDonald’s ofxFaceTracker addon for openframeworks https://github.com/kylemcdonald/ofxFaceTracker which wraps Jason’s library for easier use.
Kyle has uploaded another video giving a try at a different blending algorithm, which get rids of the artifacts and an even creepier look: http://vimeo.com/29348533