Realtime face substitution
September 21, 2011 6:58 AM Subscribe
Realtime face substitution SLVimeo
Is this something you would have to not have prosopagnosia to understand?
posted by Obscure Reference at 7:02 AM on September 21, 2011 [5 favorites]
posted by Obscure Reference at 7:02 AM on September 21, 2011 [5 favorites]
Five bucks says that, after the technique is a little less shockingly grotesque, the first commercial use of the software is going to be celebrity faces plastered onto people you pay to get naked over a webcam.
posted by griphus at 7:04 AM on September 21, 2011 [3 favorites]
posted by griphus at 7:04 AM on September 21, 2011 [3 favorites]
Your Face. Chinese YouTube is OK, really. Just another face.
posted by twoleftfeet at 7:04 AM on September 21, 2011
posted by twoleftfeet at 7:04 AM on September 21, 2011
Five bucks says that
Only five bucks? This is a comically safe bet.
Neat technology, though.
posted by rocketman at 7:10 AM on September 21, 2011 [1 favorite]
Only five bucks? This is a comically safe bet.
Neat technology, though.
posted by rocketman at 7:10 AM on September 21, 2011 [1 favorite]
Fine, I bet a round of VC capital and the attorney fees required for a succesful litigation in favor of Celebrities4U.xxx
posted by griphus at 7:15 AM on September 21, 2011
posted by griphus at 7:15 AM on September 21, 2011
No.
posted by beaucoupkevin at 7:22 AM on September 21, 2011
posted by beaucoupkevin at 7:22 AM on September 21, 2011
The Andy Warhol mask looks like Steven Tyler. Eerily so.
posted by googly at 7:23 AM on September 21, 2011
posted by googly at 7:23 AM on September 21, 2011
Wow. This is both not surprising given the recent advancements in facial processing. It's easy for a computer to now process a face, and do all kinds of 'stuff' to it, like age it And they can also parametrize and generate faces on them on the fly. One major advance is that this is actually real time, but of course it looks like crap at this point. But throw a few more GPUs at it today and you might be able to get a better result.
The other thing is -- holy shit. seeing this it's like, one of those moments where you see something that's been talked about in Sci-Fi that people would eventually be able to do and then suddenly now it's possible. It's like, it's a very strange feeling. Future Shock seems like a good word, but that's not quite what it means. It's like a weird sci-fi Deja-vu or something.
One place I'd like to see something like this used are sites like Google Maps where they have photos with everyone's faces blurred out. It seems kind of creepy. I'd rather they did something like this where they just replaced a person's face with a generic one. I think it would make it a little less creepy (or maybe more creepy -- knowing everyone you see in an image doesn't actually exist)
I see this also being used to automatically make people look better. You could take your existing face, tweak it (i.e. make it more symmetric, remove blemishes, etc) and then replace your old face with the new one.
posted by delmoi at 7:40 AM on September 21, 2011 [1 favorite]
The other thing is -- holy shit. seeing this it's like, one of those moments where you see something that's been talked about in Sci-Fi that people would eventually be able to do and then suddenly now it's possible. It's like, it's a very strange feeling. Future Shock seems like a good word, but that's not quite what it means. It's like a weird sci-fi Deja-vu or something.
One place I'd like to see something like this used are sites like Google Maps where they have photos with everyone's faces blurred out. It seems kind of creepy. I'd rather they did something like this where they just replaced a person's face with a generic one. I think it would make it a little less creepy (or maybe more creepy -- knowing everyone you see in an image doesn't actually exist)
I see this also being used to automatically make people look better. You could take your existing face, tweak it (i.e. make it more symmetric, remove blemishes, etc) and then replace your old face with the new one.
posted by delmoi at 7:40 AM on September 21, 2011 [1 favorite]
Buffalo Bill will be so pleased. Now he doesn't even have to tuck!
posted by Horace Rumpole at 7:40 AM on September 21, 2011
posted by Horace Rumpole at 7:40 AM on September 21, 2011
YESSSS. Malcovich Malcovich
posted by secondhand pho at 7:49 AM on September 21, 2011
posted by secondhand pho at 7:49 AM on September 21, 2011
Yo, Tom-B, "Realtime face substitution" is a great post title, and imma let you finish, but I just got to say "How many faces can you wear?" would have been one of the greatest post titles of all time!
posted by Rock Steady at 7:50 AM on September 21, 2011 [1 favorite]
posted by Rock Steady at 7:50 AM on September 21, 2011 [1 favorite]
New Aphex Twin video in 3, 2, 1...
posted by hanoixan at 7:58 AM on September 21, 2011 [1 favorite]
posted by hanoixan at 7:58 AM on September 21, 2011 [1 favorite]
So, this is how the end of personal identity will be ushered in.
posted by oddman at 8:11 AM on September 21, 2011
posted by oddman at 8:11 AM on September 21, 2011
There was a more convincing demo of the same idea a few years ago to show off the Cell processor's capabilities.
Which is not to take anything away from this guy. What's interesting to me is that he apparently cobbled this together on his own using off-the-shelf libraries.
posted by adamrice at 8:25 AM on September 21, 2011 [1 favorite]
Which is not to take anything away from this guy. What's interesting to me is that he apparently cobbled this together on his own using off-the-shelf libraries.
posted by adamrice at 8:25 AM on September 21, 2011 [1 favorite]
I can't wait for goggles to real-time convert everyone in to rotoscoped demon versions of themselves.
posted by Theta States at 8:28 AM on September 21, 2011
posted by Theta States at 8:28 AM on September 21, 2011
1. I love it. Want. (Not sure what that says about me.)
2. Interesting to read this right after the fpp about the French burqa ban that is protecting people from dangerous women who hide their faces.
posted by Surfurrus at 8:36 AM on September 21, 2011
2. Interesting to read this right after the fpp about the French burqa ban that is protecting people from dangerous women who hide their faces.
posted by Surfurrus at 8:36 AM on September 21, 2011
I hate the future.
I love the future! Our future porn is going to be so freaking weird!
posted by The Whelk at 8:36 AM on September 21, 2011 [1 favorite]
I love the future! Our future porn is going to be so freaking weird!
posted by The Whelk at 8:36 AM on September 21, 2011 [1 favorite]
Why does it look crappy? Like you can see the effect, but there is a ton of color artifacts that make it obviously fake. Because he isn't working with proper face scans, just photos?
posted by smackfu at 8:43 AM on September 21, 2011
posted by smackfu at 8:43 AM on September 21, 2011
That guy + Brad Pitt = Benicio Del Toro
posted by itstheclamsname at 8:48 AM on September 21, 2011 [1 favorite]
posted by itstheclamsname at 8:48 AM on September 21, 2011 [1 favorite]
Yeah Rock Steady I only noticed it later, I combo-broke some sort of "How many" front page meme, MY BAD
posted by Tom-B at 8:53 AM on September 21, 2011 [1 favorite]
posted by Tom-B at 8:53 AM on September 21, 2011 [1 favorite]
Interesting that it seems (to me at least) to work better on the black-and-white images. Perhaps then the bleed-through of the guy's natural skin tone makes the photo somehow work better on his face. Also, does not work properly on source pictures where the subject is smiling. Very interesting.
posted by dellsolace at 8:54 AM on September 21, 2011
posted by dellsolace at 8:54 AM on September 21, 2011
Michael Jackson's maps almost flawlessly.
posted by codacorolla at 9:28 AM on September 21, 2011 [1 favorite]
posted by codacorolla at 9:28 AM on September 21, 2011 [1 favorite]
smackfu, I'm guessing that the 3d geometry mesh gets crumpled in the matching process. Shading is computed wrong because surface normals are pointing in strange directions, might be even just a bug in the code. To do the same thing propery, one would use only high-key photos with no apparent shading and an approximately correct 3d mesh, or alternatively the other way round, no lighting computation at all and a photo which has been taken in uniform lighting. But this is art, not a technical demonstration.
posted by ikalliom at 10:02 AM on September 21, 2011
posted by ikalliom at 10:02 AM on September 21, 2011
Actually here's another version that's linked in the video description box now. It's done by someone else but they made it a lot smoother looking.
posted by delmoi at 10:41 AM on September 21, 2011 [2 favorites]
posted by delmoi at 10:41 AM on September 21, 2011 [2 favorites]
Interesting, delmoi. It seems to adjust for an open mouth (by not retexturing that part of the face), which only works if the source image has closed lips.
posted by smackfu at 10:58 AM on September 21, 2011
posted by smackfu at 10:58 AM on September 21, 2011
The smoother (and more mask-like) the face, the better it seems to work. Like the Marilyn Monroe one.
posted by Theta States at 12:39 PM on September 21, 2011
posted by Theta States at 12:39 PM on September 21, 2011
I can't wait for goggles to real-time convert everyone in to rotoscoped demon versions of themselves.
Or as I like to call it; "Hungover on a Saturday".
posted by quin at 2:22 PM on September 21, 2011 [1 favorite]
Or as I like to call it; "Hungover on a Saturday".
posted by quin at 2:22 PM on September 21, 2011 [1 favorite]
It's only a short matter of time (I hope) before this gets picked up for multiplayer online games, and your facial expression gets translated to your avatar's mesh. Throw in a Kinect and maybe some gaze tracking and you've got a recipe for natural body language in virtual worlds, which should be pretty awesome to see.
posted by NMcCoy at 2:31 PM on September 21, 2011
posted by NMcCoy at 2:31 PM on September 21, 2011
It's like a weird sci-fi Deja-vu or something
I think the best term for this is post-futurist. Vivian Sobchack coined the term to describe a type of SF genre film design which depicted futurist objects as used, dirty and dented. Post-Futurism observes our underwhelmed reception of anything new, as it has long ago been predicted and their effects dissected (i.e. "everything new is old already").
/derail
posted by In The Annex at 7:31 PM on September 21, 2011
I think the best term for this is post-futurist. Vivian Sobchack coined the term to describe a type of SF genre film design which depicted futurist objects as used, dirty and dented. Post-Futurism observes our underwhelmed reception of anything new, as it has long ago been predicted and their effects dissected (i.e. "everything new is old already").
/derail
posted by In The Annex at 7:31 PM on September 21, 2011
Well, I like it. Especially the Paris Hilton one. Hmm.
posted by bberchant at 8:55 AM on September 22, 2011
posted by bberchant at 8:55 AM on September 22, 2011
« Older How many people traveled on the space shuttle? | But I really don't want to know Newer »
This thread has been archived and is closed to new comments
posted by FAMOUS MONSTER at 7:01 AM on September 21, 2011 [2 favorites]