One million comic book panels
April 12, 2017 12:21 PM Subscribe
Mohit Iyyer, Varun Manjunatha, Anupam Guha, Yogarshi Vyas, Jordan Boyd-Graber, Hal Daumé III and Larry Davis decided to train a neural network on ordered sequences of comic book panels to see if they could then determine what was happening in the current panel. (No.)
To feed the network, they created a 120 gigabyte collection of one million comic book panels in isolation. You can download it here. (source code) (h/t Data Is Plural)
To feed the network, they created a 120 gigabyte collection of one million comic book panels in isolation. You can download it here. (source code) (h/t Data Is Plural)
Isn't this copyrighted material?
Good question. They got that figured out: "The Digital Comics Museum (DCM) hosts user-uploaded scans of many comics by lesser-known Golden Age publishers that are now in the public domain due to copyright expiration."
posted by clawsoon at 1:28 PM on April 12, 2017 [1 favorite]
Good question. They got that figured out: "The Digital Comics Museum (DCM) hosts user-uploaded scans of many comics by lesser-known Golden Age publishers that are now in the public domain due to copyright expiration."
posted by clawsoon at 1:28 PM on April 12, 2017 [1 favorite]
The Digital Comic Museum, a site for downloading free public domain Golden Age Comics, previously (twice, and thrice).
posted by filthy light thief at 1:45 PM on April 12, 2017 [3 favorites]
posted by filthy light thief at 1:45 PM on April 12, 2017 [3 favorites]
I'd love to browse this, but would not love to download a 63 gig file. Also, shout out to UMIACS. They're on my campus and do some work with my department, and I'm always amazed at the sort of stuff that they put out.
posted by codacorolla at 2:04 PM on April 12, 2017
posted by codacorolla at 2:04 PM on April 12, 2017
Mohit Iyyer, Varun Manjunatha, Anupam Guha, Yogarshi Vyas, Jordan Boyd-Graber, Hal Daumé III and Larry Davis decided to train a neural network on ordered sequences of comic book panels to see if they could then determine what was happening in the current panel.
Anyone who's ever read a Golden Age comic book could tell you that most humans struggle to understand what's going on in them. So many of them were completely crazy, not in a zany Silver Age way, but in a "it's like someone wrote down their dreams" way.
Exhibit A: Stardust the Super Wizard
posted by Sangermaine at 2:05 PM on April 12, 2017 [5 favorites]
Anyone who's ever read a Golden Age comic book could tell you that most humans struggle to understand what's going on in them. So many of them were completely crazy, not in a zany Silver Age way, but in a "it's like someone wrote down their dreams" way.
Exhibit A: Stardust the Super Wizard
posted by Sangermaine at 2:05 PM on April 12, 2017 [5 favorites]
I'm happy that Eisner, W., McCloud, S., and Goulart, R., are mentioned in the bibliography.
posted by ardgedee at 4:28 PM on April 12, 2017
posted by ardgedee at 4:28 PM on April 12, 2017
In other thoughts, maybe COMICS can be put to work storyboarding Michael Bay's next movies. There's no risk of it being less coherent than anything Bay's done to date.
posted by ardgedee at 4:29 PM on April 12, 2017
posted by ardgedee at 4:29 PM on April 12, 2017
I just want to play 10,000 Card Nancy.
posted by Going To Maine at 4:37 PM on April 12, 2017 [4 favorites]
posted by Going To Maine at 4:37 PM on April 12, 2017 [4 favorites]
Any examples or illustrations posted online? No way am I downloading that, but I'd like to see the failure.
posted by kittensofthenight at 5:03 PM on April 12, 2017 [1 favorite]
posted by kittensofthenight at 5:03 PM on April 12, 2017 [1 favorite]
Jordan Boyd-Graber is a friend of mine from quiz bowl days. He also invented a machine called QANTA that can play quiz bowl. What he can program a computer to "understand" is absolutely amazing.
posted by jonp72 at 5:49 PM on April 12, 2017
posted by jonp72 at 5:49 PM on April 12, 2017
kittensofthenight: Any examples or illustrations posted online? No way am I downloading that, but I'd like to see the failure.
Catfish creek jail - an example of an incorrect candidate, from images on the Semantic Scholar hosting of the paper
(Also from the figures and tables: Figure 1. Where did the snake in the last panel come from? Why is it biting the man? Is the man in the second panel the same as the man in the first panel?)
posted by filthy light thief at 10:23 PM on April 12, 2017 [1 favorite]
Catfish creek jail - an example of an incorrect candidate, from images on the Semantic Scholar hosting of the paper
(Also from the figures and tables: Figure 1. Where did the snake in the last panel come from? Why is it biting the man? Is the man in the second panel the same as the man in the first panel?)
posted by filthy light thief at 10:23 PM on April 12, 2017 [1 favorite]
In the spirit of GIGO, if this is what we are using to trigger the ignition of the Singularity, oh we are so screwed.
posted by sammyo at 9:14 AM on April 13, 2017
posted by sammyo at 9:14 AM on April 13, 2017
« Older Yardsharing | The Arc of Her Survival Newer »
This thread has been archived and is closed to new comments
posted by dilaudid at 12:54 PM on April 12, 2017 [1 favorite]