The digital equivalent of stashing a dirty magazine under your mattress May 23, 2013 1:13 PMSubscribe
When news came through of Yahoo! buying Tumblr, everyone wanted to know what that meant for all the porn on Tumblr. But it turns out that long before Yahoo! signed a check, Tumblr had been quietly doing something about it on its own: stopping adult blogs from being indexed. [NSFW links] Long-time smut blogger Bacchus has unearthed that over the last few months, all Tumblr blogs marked "adult" have a robots.txt that blocks all indexing by search engines and archives. So Google will never find your Teen Wolf slash art blog.