skip to main content
4 posts tagged with searchengines and technology. (View popular tags)
Displaying 1 through 4 of 4. Subscribe:
Is Grub out of control? Barely more than a week old, the distributed search engine is already causing headaches. It does not properly follow the
Robot Exclusion Standard and thus spiders sites against their owners' wishes. Because it is a distributed client run by thousands of volunteers (and therefore connects from many different IP addresses), it is non-trivial to block. The Wikipedia project, for example, is
experiencing slowdowns because of it. Let's hope they can solve these problems, as the idea seems to be quite cool.
posted by Eloquence
on Apr 23, 2003 -
7 comments
YAHOOGLE!! Your average weblogger's favorite search engine makes the big time (and they just hit a billion pages indexed, too). Will success spoil
the Googs?
posted by wendell
on Jun 27, 2000 -
5 comments
Page:
1