August 3, 2006
Perlmonks blocking robots
Perlmonks has started blocking all robots. The message says:
# sorry, but misbehaved robots have ruined it for all of you.
I don’t get it…why try blocking robots in robots.txt? Misbehaving ones will ignore it and you’ll just exclude it from the beneficial one. Optionally, you can exclude all except for the few major search engines.
You see, here is my problem. I can’t stand the Perlmonks search engine. It is very slow and very irritating. It’s quality of results is also sometimes questionable. The way I resolve this is that I go to Google and type in
“_query term_ site:perlmonks.com” … only one problem…I can’t do that anymore! 
As for the SEOs that read this, I would imagine most traffic to perlmonks comes from people going there directly…They have this community bulletin board where people ask for perl programming help and people offer up their help.
(No Ratings Yet)
Loading ...
