Comments on: Aaaaaand we'll just remove a nice, happy tree from riiiiight......abouuuuuut....there. That's nice.

Aaaaaand we'll just remove a nice, happy tree from riiiiight......abouuuuuut....there. That's nice.

lazaruslong — Fri, 26 Mar 2010 11:50:21 -0800

We've already seen seam carving for content-aware image resizing. Now, here's content-aware fill.

By: jsavimbi

jsavimbi — Fri, 26 Mar 2010 11:59:19 -0800

That was very impressive, but can it make me a better photographer with my $99 special?

By: jeffkramer

jeffkramer — Fri, 26 Mar 2010 12:00:37 -0800

You can't believe your eyes. You never really could, but now you really can't. Give us what, 5 years before we have sunglasses that automagically remove things you don't want to see? We already have robots on Mars picking out objects of interest by themselves.

By: griphus

griphus — Fri, 26 Mar 2010 12:01:02 -0800

Note to self: Roll 401K over into "quantity of horrible, naked things emerging from 4chan" fund before this feature drops.

By: shakespeherian

shakespeherian — Fri, 26 Mar 2010 12:01:04 -0800

I still don't understand the processing on the last picture. It seems to indicate that Photoshop is content-aware enough to add a bird in the top left corner.

By: The Lurkers Support Me in Email

The Lurkers Support Me in Email — Fri, 26 Mar 2010 12:04:26 -0800

I've seen this link floating around the blogotubes over the last few days and have been thinking, "Didn't Photoshop get content-aware mumblesomething over a year ago?" I guess content-aware fill works on a lot of the same principles as content-aware resizing, working in two dimensions instead of one, but seeing it in action still breaks my brain. Think of the evil I could do with this! Mwahahah...err, sorry.

By: wemayfreeze

wemayfreeze — Fri, 26 Mar 2010 12:07:26 -0800

The last one seems way fake to me. What is the deal?

By: CheeseDigestsAll

CheeseDigestsAll — Fri, 26 Mar 2010 12:08:02 -0800

So if you start with a blank canvas and do a content aware delete, does PS generate the photo you should have taken?

By: The World Famous

The World Famous — Fri, 26 Mar 2010 12:10:40 -0800

This is amazing. But it strikes me as fake. Maybe it's a proof-of-concept demonstration or something? Like shakespeherian, I want to know how Photoshop decided to put a bird in the last picture. And on the dirt road picture, how did it decide to turn the bush on the left into a tree? The demo goes from "ok, that's cool" to "what? That's fake" pretty quickly.

By: betweenthebars

betweenthebars — Fri, 26 Mar 2010 12:11:15 -0800

I saw this yesterday - I could not stop watching the little trees disappear.

By: echo target

echo target — Fri, 26 Mar 2010 12:12:23 -0800

Badass. I might have to go beg my boss for an upgrade.

By: Vamier

Vamier — Fri, 26 Mar 2010 12:14:48 -0800

That's not a bird, it's an artifact of where the cursor was...

By: swift

swift — Fri, 26 Mar 2010 12:15:16 -0800

That's no moon.

By: PhoBWanKenobi

PhoBWanKenobi — Fri, 26 Mar 2010 12:15:32 -0800

That's pretty awesome. That being said, it's pretty funny that he refers to the status bar crawling across the screen in the last one as "racing" and then reminds us of how long it would take without the feature.

By: griphus

griphus — Fri, 26 Mar 2010 12:15:33 -0800

So if you start with a blank canvas and do a content aware delete, does PS generate the photo you should have taken? Content-aware fill is going to become a Zen teaching tool. "Without thinking of copy or paste, content-aware-fill your original face before your mother and father are photographed."

By: Threeway Handshake

Threeway Handshake — Fri, 26 Mar 2010 12:16:23 -0800

I want to know how Photoshop decided to put a bird in the last picture. The "bird" is clearly the lasso mouse pointer. You can watch him select with it, and it even turns into the mac "wait" pointer while it is churning.

By: The World Famous

The World Famous — Fri, 26 Mar 2010 12:18:26 -0800

That's not a bird, it's an artifact of where the cursor was... Now that I look again, I think you're right. It's the cursor. If you had a photo of just the top half of Spock's face and did a content-aware-fill of the rest, would the resulting image have a beard or not? And would the outcome be different if it was a photo of Riker?

By: m@f

m@f — Fri, 26 Mar 2010 12:19:12 -0800

If a tree is content aware deleted in a forest and no one is around, did it ever exist?

By: Jon_Evil

Jon_Evil — Fri, 26 Mar 2010 12:20:50 -0800

tiny little photoshop gnomes, infesting your computer. that's the only way it's possible. the reason adobe products are so expensive is because they have to put all those gnomes through art school.

By: m@f

m@f — Fri, 26 Mar 2010 12:23:27 -0800

If you had a photo of just the top half of Spock's face and did a content-aware-fill of the rest... Seriously, though... I am very curious to see how this would handle an exquisite corpse.

By: LoopyG

LoopyG — Fri, 26 Mar 2010 12:30:51 -0800

For what its worth from a random internet dude: I work in computer vision aka image processing. This technology (image inpainting) is something the community has been working on for more than a decade. These results do not seem fake to me, as I have seen algorithms give results of this caliber plenty of times before. What does impress me is they trust the results enough to unleash it in the wild. I imagine there will be many cases where it leaves artifacts, but it seems they are encouraging it as a first-pass tool. Use the content-aware fill, and then touch up that result, because that is still faster than starting from scratch.

By: mygothlaundry

mygothlaundry — Fri, 26 Mar 2010 12:33:59 -0800

So, okay, there is going to be a reason to get 5. I've been muttering for years that there's nothing wrong with 3 that 4 solves and grumble, bitch, I can't afford it, complain - but if this really works it's pretty damn amazing.

By: shakespeherian

shakespeherian — Fri, 26 Mar 2010 12:36:21 -0800

The "bird" is clearly the lasso mouse pointer. You can watch him select with it, and it even turns into the mac "wait" pointer while it is churning. Yeah, you're right, it is the cursor. Which actually makes me feel better, because I couldn't imagine creating the first part of the video (with the park photo) as a hoax-- it would be far too laborious and pointless. The last part didn't make any sense being a fake, so I'm glad to know I was wrong.

By: Kabanos

Kabanos — Fri, 26 Mar 2010 12:39:50 -0800

Adobe's presentation at SIGGRAPH (August 2009). And the paper describing how itworks.

By: Kabanos

Kabanos — Fri, 26 Mar 2010 12:43:30 -0800

argh. Need content aware MeFi comments to fix those typos!

By: uncleozzy

uncleozzy — Fri, 26 Mar 2010 12:48:10 -0800

I bet this is extra-super-amazing when you're baked. Kind of like most things. But still.

By: juv3nal

juv3nal — Fri, 26 Mar 2010 12:49:03 -0800

For what its worth from a random internet dude: I work in computer vision aka image processing. This technology (image inpainting) is something the community has been working on for more than a decade. These results do not seem fake to me, as I have seen algorithms give results of this caliber plenty of times before. Yeah ditto the not fake. I've done a shoddy version of the thing that goes on at about 3:30 with the dirt road as an assignment in an undergrad class using matlab and that was 4(?) years ago. I don't remember much of how to do any of it, but it was a neat class.

By: pokermonk

pokermonk — Fri, 26 Mar 2010 12:52:59 -0800

Here's Adobe's page on "PatchMatch" which provides a slightly nerdier video explanation of what's going on and might hint at another capability we have yet to see.

By: cashman

cashman — Fri, 26 Mar 2010 12:53:13 -0800

I still think it's an early present for next Wednesday.

By: cashman

cashman — Fri, 26 Mar 2010 12:53:56 -0800

Or, next Thursday.

By: delmoi

delmoi — Fri, 26 Mar 2010 12:58:49 -0800

There are a lot of interesting things being done in machine vision and soforth. It kind of pisses me off that adobe acts like they came up with all of this totally on their own. Obviously integrating it into a product and making it useful for people is a big step forward. But this is hardly their work alone. Anyway, anyone else notice the weird sky on the 'expansion'? It seemed like there was this blue artifact where the seam would have been on the left. Also, I think on some of the content aware fills it looked like there was a weird seam around where the edge was. Still, no doubt this would save you a TON of time. just cleaning up the glitches instead of doing all the work yourself. But I don't think this would look as good if it wasn't packed down to a tiny, blurry youtube video. Certainly, they could have uploaded a higher-resolution version if they'd wanted too.

By: delmoi

delmoi — Fri, 26 Mar 2010 12:59:45 -0800

Er, I should say "It kind of pisses me off that adobe acts like they came up with all of this totally on their own in this video"

By: smackfu

smackfu — Fri, 26 Mar 2010 13:14:57 -0800

But really, getting it into Photoshop or some other consumer product is all that matters.

By: East Manitoba Regional Junior Kabaddi Champion '94

East Manitoba Regional Junior Kabaddi Champion '94 — Fri, 26 Mar 2010 13:16:03 -0800

This is mindblowing stuff. It's mindblowing that it took Adobe so long to copy this feature from GIMP.

By: Blazecock Pileon

Blazecock Pileon — Fri, 26 Mar 2010 13:18:49 -0800

This will be perfect for newspapers and governments.

By: fings

fings — Fri, 26 Mar 2010 13:34:55 -0800

Gimp plugin here: http://www.logarithmic.net/pfh/resynthesizer If you're running Ubuntu, "sudo apt-get install gimp-resynthesizer".

By: emeiji

emeiji — Fri, 26 Mar 2010 13:39:49 -0800

My mouth fell open as the sky appeared, and hours and hours of my life flashed before my eyes.

By: Legomancer

Legomancer — Fri, 26 Mar 2010 13:43:18 -0800

Wait wait wait...someone using Photoshop to remove lens flares?

By: GuyZero

GuyZero — Fri, 26 Mar 2010 13:45:41 -0800

Apparently there's been a GIMP plugin to do this for a while now.

By: LordSludge

LordSludge — Fri, 26 Mar 2010 13:52:31 -0800

True, but nobody can figure out how to use it in GIMP.

By: cjorgensen

cjorgensen — Fri, 26 Mar 2010 13:59:44 -0800

via?

By: smackfu

smackfu — Fri, 26 Mar 2010 14:10:34 -0800

This is mindblowing stuff. It's mindblowing that it took Adobe so long to copy this feature from GIMP. Ha. That says more about GIMP than about Adobe.

By: twoleftfeet

twoleftfeet — Fri, 26 Mar 2010 14:10:59 -0800

It used to take the Soviet Union days to do this.

By: XMLicious

XMLicious — Fri, 26 Mar 2010 14:17:03 -0800

Arrgh, damn it twoleftfeet you just beat me to it.

By: ook

ook — Fri, 26 Mar 2010 14:24:53 -0800

So, okay, there is going to be a reason to get 5. I'm curious if this will actually show up in CS5; they've been pretty careful to not mention a version number in relation to it. On youtube they describe it as "what could happen in the future," and when John Nack blogged about it recently, he says only "a future version of Photoshop".

By: DU

DU — Fri, 26 Mar 2010 14:32:27 -0800

This is mindblowing stuff. It's mindblowing that it took Adobe so long to copy this feature from GIMP. CMYK CMYK CMYK I CAN'T HEAR YOU

By: quin

quin — Fri, 26 Mar 2010 14:43:13 -0800

So.. it's been a while since I've been in the Photoshop game, when exactly did Adobe start trafficking in magic, witchcraft, and other dark arts? Because *points at screen* that's some sorcery shit I'm seeing right there.

By: The Winsome Parker Lewis

The Winsome Parker Lewis — Fri, 26 Mar 2010 14:47:22 -0800

I use the GIMP and honestly, it's not that bad once you get the hang of it. I was drooling over this video though, until I learned I could do the same thing with free software. I'm definitely going to give Resynthesizer a try. Anybody know if content-aware resizing is also available for the GIMP? I so want to get my grubby hands all over that crap.

By: quin

quin — Fri, 26 Mar 2010 15:09:11 -0800

So if you start with a blank canvas and do a content aware delete, does PS generate the photo you should have taken? My friend had this brilliant (silly) idea; he wants to write a program that takes a photograph sized array of pixels and have them as quickly as possible cycle through all the possible color combinations for each pixel and then save any interesting results. The upshot of this, is that if you had the storage space, eventually, you would end up with every photograph ever. You'd also have every frame from every movie, including the ones that have never been made. You'd have photos of the pyramids being built, and then photos of them being destroyed by the robot monsters that attacked during the dark ages. Same with the ones of Jesus and Batman fighting off zombie serial molester plague of 2125. His idea is that any photos that don't already fall under someone else's copyright, would belong to him. And that would mean that he would hold the every photo into the future that hadn't already been taken. (I believe that he ended this last sentence with a maniacal, evil genius styled laugh). All I want is a couple of the more dirty ones so that I can get rich off of hypothetical blackmail for events that haven't actually happened yet.

By: The Winsome Parker Lewis

The Winsome Parker Lewis — Fri, 26 Mar 2010 15:19:08 -0800

...and a roomful of monkeys with typewriters will eventually reproduce the entire oeuvre of Shakespeare... or not...

By: smackfu

smackfu — Fri, 26 Mar 2010 15:30:33 -0800

Well, you really only have to do all the variations of one page. Only like 26³²⁰⁰ or so.

By: purephase

purephase — Fri, 26 Mar 2010 15:32:51 -0800

As cool as this is, it is a little bit frightening as well. What if content-awareness makes us aware of something we would rather not see?

By: 0xFCAF

0xFCAF — Fri, 26 Mar 2010 15:48:53 -0800

To summarize the thread thus far:

This is definitely fake
I definitely did this in undergrad / GIMP definitely has had this for years

We need to update the maxim to be "Any sufficiently advanced technology is indistinguishable from fakery"

By: callmejay

callmejay — Fri, 26 Mar 2010 16:10:16 -0800

I was literally yelling at my laptop this week because of GIMP. I cut an orange logo and paste it into an image. And it turned green. What. The. Fuck. I got to the point of yelling and downloaded Paint.NET. No problem. That content-aware fill is ridiculous. That can't be real, can it? I love living in the future.

By: maudlin

maudlin — Fri, 26 Mar 2010 16:12:12 -0800

Favourited not just for the linked video but for the post title.

By: The World Famous

The World Famous — Fri, 26 Mar 2010 16:15:21 -0800

We need to update the maxim to be "Any sufficiently advanced technology is indistinguishable from fakery" I suspect that, if the resolution of the video were higher, nobody would think it is fake, because they would be able to see that it's not as seamless as the blurry video makes it look.

By: aeschenkarnos

aeschenkarnos — Fri, 26 Mar 2010 16:20:06 -0800

quin My friend had this brilliant (silly) idea; he wants to write a program that takes a photograph sized array of pixels and have them as quickly as possible cycle through all the possible color combinations for each pixel and then save any interesting results. Jorge Luis Borges The Library of Babel. Of course, it's a concept beyond mere impossibility, but it does raise interesting questions for copyright law. When Sony or something similar asserts copyright over Track4.mp3, they are asserting copyright over "sufficiently similar" works. That is, all works that are not meaningfully distinguishable from Track4.mp3, that can be listened to and identified as the same track. That is, containing enough of the same data. This can be varied quite a lot, and still be identifiable. Maybe up to 50% of the bytes can be varied. This means that for a 5MB mp3 file, there also exists a "shadow cloud" of 2 ^{(2.5 x 8 x 1024 x 1024)} works to which that copyright also applies, each of which the copy of Track4.mp3 on your iPod also infringes.

By: ericost

ericost — Fri, 26 Mar 2010 16:24:39 -0800

shopped

By: pwnguin

pwnguin — Fri, 26 Mar 2010 16:56:52 -0800

The Winsome Parker Lewis: "Anybody know if content-aware resizing is also available for the GIMP? I so want to get my grubby hands all over that crap." This is what people cite as the GIMP version, however last I checked it was buggy as hell. If you expand an image it picks the same path to resize over and over again. The original paper noticed this and documented a fairly obvious fix: when you grow by n pixels on a dimension, rather than find the best path to expand n times, find the n best paths to expand.

By: smackfu

smackfu — Fri, 26 Mar 2010 17:12:59 -0800

The part that puzzles me is where the GIMP guy got the originals to recreate it. I'd also love to see the full-size images he created. I've seen a ton of stuff that looks good when zoomed out but has flaws all over in 100% mode. (For instance, nearly every panorama I've stitched.)

By: EndsOfInvention

EndsOfInvention — Fri, 26 Mar 2010 18:20:24 -0800

This is nothing new. I've been using content-aware fill to pad out MetaFilter comments that I couldn't think how to finish for ages. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam placerat faucibus urna a dapibus. Mauris non nunc massa. Ut erat ipsum, mattis vel pellentesque eu, mollis non nisl. Aliquam vehicula metus eget dolor suscipit viverra. In dapibus magna non massa accumsan sagittis. But that last one with the clouds fucking blew my mind.

By: oulipian

oulipian — Fri, 26 Mar 2010 18:32:49 -0800

My friend had this brilliant (silly) idea; he wants to write a program that takes a photograph sized array of pixels and have them as quickly as possible cycle through all the possible color combinations for each pixel and then save any interesting results. Check out John F. Simon's Every Icon.

By: oulipian

oulipian — Fri, 26 Mar 2010 18:34:33 -0800

"Though, for example, at a rate of 100 icons per second (on a typical desktop computer), it will take only 1.36 years to display all variations of the first line of the grid, the second line takes an exponentially longer 5.85 billion years to complete." - Artist's Statement

By: edheil

edheil — Fri, 26 Mar 2010 18:42:11 -0800

Yep, this is what GIMP has had for a few years in the plugin Resynthesizer, just with a way way slicker user interface (much like their content aware resizing feature -- much nicer UI than the free software equivalents.)

By: aneel

aneel — Fri, 26 Mar 2010 19:54:08 -0800

This was my take on the every icon idea. You can drill down to find any icon you want.

By: niccolo

niccolo — Fri, 26 Mar 2010 21:10:13 -0800

Will I be able to do this in the future with words? I type 'future', 'do', 'words', and keep typing until I get the previous sentence? To eliminate the need for sequence in writing?

By: Duke999R

Duke999R — Fri, 26 Mar 2010 21:35:22 -0800

Nahhhhh. I don't trust this video shit. Pics or it didn't happen!

By: lazaruslong

lazaruslong — Fri, 26 Mar 2010 23:50:49 -0800

cjorgensen: "via?" Nah, I didn't see it there. It was a random video linked on VideoSift that I thought was cool. I'm sure its all over all sorts of blogs. If I had come across it as a result of a blog, I would have given credit.

By: thejoshu

thejoshu — Sat, 27 Mar 2010 08:41:21 -0800

Of course it's fake. The whole point is that it's fake. It's just a question of whether you're being fooled by man or machine. Meta!

By: five fresh fish

five fresh fish — Sat, 27 Mar 2010 10:07:27 -0800

I believe someone did the "cycle X to copyright all Y" with notes, too, during the early days of DRM stupidity.

By: cjorgensen

cjorgensen — Sat, 27 Mar 2010 11:05:41 -0800

If I had come across it as a result of a blog, I would have given credit. Cool. That's just where I saw it first, was wondering if you had as well.

By: chairface

chairface — Sat, 27 Mar 2010 13:36:43 -0800

Little known fact: It took Adobe only 2 weeks to copy this from the GIMP. It took them 2 years to figure out how to install GIMP and the plugin, then how to open up an image.

By: Twang

Twang — Sat, 27 Mar 2010 18:29:51 -0800

Pretty cool looking ... but I'm gonna needa see what it does with an astronaut or a comrade before I make up my mind. And maybe that grassy knoll ... gunman or trick-of-the-light?

By: seanyboy

seanyboy — Sun, 28 Mar 2010 03:40:39 -0800

DO NOT try to content aware fill blank space. There are eldritch beasts that live in the folds of blankness, and this could bring them forth. Well that, or a fuzzy, squint your eyes and it's sort of right, picture of Jesus.

By: miyabo

miyabo — Sun, 28 Mar 2010 08:15:56 -0800

Did anyone else notice that Facebook crops profile pictures to the biggest face in the image (to generate the profile thumbnails)?

By: lazaruslong

lazaruslong — Mon, 29 Mar 2010 11:12:38 -0800

Haha it was only a matter of time until someone made a video about this.

By: ook

ook — Mon, 29 Mar 2010 11:40:15 -0800

Excellent use of the "it's made a sandwich" tag, there.