All around me are familiar faces
January 9, 2014 11:02 AM   Subscribe

clmtrackr is a novel javascript library allowing realtime face detection, fitting and tracking within a browser. The demo applications (which recommend Chrome, although other recent browsers also appear to work) will accept input from your webcam if available, and include facial tracking, emotion detection (requires webcam input) and the creepier face substitution and masking. [via]

The face substitution demo is inspired by similar work by Kyle McDonald and Arturo Castro, featured previously (1, 2) on MetaFilter.
posted by figurant (18 comments total) 34 users marked this as a favorite

Yowsers. Didn't think this tech could be this freely available.
posted by ZeusHumms at 11:06 AM on January 9

seems thrown off by my glasses. Too bad. I think it works if I take them off but... the screen is really fuzzy so I can't tell. Anyway, neat. Soon all software will be javascript it seems.
posted by GuyZero at 11:07 AM on January 9 [2 favorites]

Was this written natively in JavaScript, or compiled to JavaScript from another language?
posted by jsturgill at 11:09 AM on January 9

Man, that is creepy as hell. One of the buildings I regularly walked through at college more than a decade ago had a crude face-tracker on display--a camera pointed at the hall and highlighted all the faces it saw on a nearby monitor--but this is something else entirely. I really love it.
posted by uncleozzy at 11:09 AM on January 9

There's always CV Dazzle for cyberpunks willing to trade higher human-noticeability for lower machine-noticeability.
posted by byanyothername at 11:13 AM on January 9 [2 favorites]

jsturgill: "Was this written natively in JavaScript, or compiled to JavaScript from another language?"

It seems to have been written in JS, since the code looks person- and not compiler-authored, the heavy number-crunching bits notwithstanding.
posted by invitapriore at 11:27 AM on January 9 [1 favorite]

Face averaging is maybe my favorite thing ever now.
posted by cellphone at 11:27 AM on January 9

Thanks, figurant. This is amazing. I do not need more stuff to do, but now I want to work this into something.
posted by ignignokt at 11:34 AM on January 9

The face substitution is quite scary. I could only get it to work for a few seconds at a time, and then it would jump about and miss my face - I think there's not enough light in my room (and my webcam's crap).
Soon all software will be javascript it seems.
I hope not. Javascript is horrible.
posted by leo_r at 11:34 AM on January 9

I'm pretty sure the emotion detection just accused me of having bitchy resting face.
posted by Sequence at 11:43 AM on January 9 [2 favorites]

Substitute selfie! This is neat as hell.
posted by ignignokt at 11:44 AM on January 9 [1 favorite]

I thought this was going to be about the creepy Nametag app featured on BoingBoing. DO NOT WANT.

A new mobile app called "Nametag" adds facial recognition to phone photos; take a pic of someone and feed it to the app and the app will search Facebook, Twitter, sex offender registries and (if you'd like) dating sites to try and put a name to the face. Kevin Alan Tussy, speaking for Facialnetwork (who make Nametag) promises that this won't be a privacy problem, because "it's about connecting people that want to be connected."
posted by emjaybee at 11:47 AM on January 9

As a person who cannot remember names Nametag tied to a real-time Google Glasses type interface would be life changing. Work is a constant mine-field of needing to ask someone a question, someone I've known and talked to for months, and not having a clue how what their actual name is. Family reunions are a nightmare.

I do wonder what face substitution tech will mean for video surveillance as court evidence. This is clunky sure, but it's a) real-time, and b) Javascript running in your browser! CGI is already good enough that the vast majority of it is not noticed in film anymore, how soon before you can just replace an actor's face altogether? Not those goofy dead celebrities dancing with a vacuum, but convincingly resurrecting Bogart or circa 1980 Tom Cruise.
posted by Eddie Mars at 12:18 PM on January 9 [1 favorite]

I have lots and lots of pictures drawn by my students (6-8 year olds) on the wall behind me, and it's interesting to see what the program chooses to replace when there's no actual face in view... there are lots of drawings of me, but the go-to picture seems to be a Minecraft creeper, which looks pretty funny with justin bieber's face.

Now it's choosing a plastic porcupine fish I have on the table behind me. OK, Abstract(scream) is pretty disturbing.
posted by Huck500 at 12:22 PM on January 9

JS is horrible, he said using an interface written in JS.
posted by effugas at 12:35 PM on January 9 [3 favorites]

Substitute selfie! This is neat as hell.

You, or someone else, will be hailed as a literal prophet.
posted by srboisvert at 12:43 PM on January 9

It doesn't like my beard.
posted by rikschell at 6:24 PM on January 9

My beard also appears to thwart the face-replacement robot. You'd think it would be hipster-friendly.
posted by grumpybear69 at 9:34 PM on January 9

« Older "Everybody Loves Sondheim, You Guys"   |   The Giants of Potsdam Newer »

This thread has been archived and is closed to new comments