webmasterworld.com which recently banned all the search engine robots via it’s robots.txt file.. has been Removed completely in Google. Webmasterworld.com has not had a search function for quite a while and most people used Google to site search webmasterworld.com
DaveN
added : thread here on SEW about webmasterworld.com
9 Comments
-
1
23rd November 2005 @ 16:20
-
2
Brett ain’t your born yesterday kid. The lack of search is going to stink, but will it be for long? Maybe he’s bought some Google search hardware. Or has something else up his sleeve.
23rd November 2005 @ 16:58
-
3
I don’t use WMW much now that the DaveN, TW, & WG blogs are around, but it’d still be a shame to see it tank from this. Hope Brett’s got a plan.
23rd November 2005 @ 22:30
-
4
I agree with comment 1. I thought that Brett was smarter than this… Unless it is purely to get more backlinks as people comment on the move, in which case he IS smarter than us all. That robots.txt will be changed back within no time, I would wager. I certainly don’t buy that it is to stop rogue robots because there are many, many solutions to that which could be explored and would be far more successful than this!
23rd November 2005 @ 23:47
-
5
Maybe there is something we are missing? Does he know something we don’t?
Surely it can’t be such a simple mistake coming from a respected site as this.
Also, why has it dropped right away? Was there human intervention? Be interesting to see if anything filters out of Google the next few weeks regarding this.
I wonder if anyone will test this on one of their own sites unanounced to see how quick google removes them.
Certainly never a dull day on the Island of Search.
24th November 2005 @ 16:52
-
6
I really think that was a silly move to remove spider indexing. I guess we all have our own thing. I hope Brett changes his mind and fixes it…
25th November 2005 @ 12:14
-
7
Yeah, I think most are missing it. I think Brett is trying to save a sinking ship. I really don’t buy the story that the load is too high and robots.txt is the fix. I think its only a desperate attempt to keep newbies out so that the noise ratio goes down.
Too little too late.
28th November 2005 @ 02:08
-
8
Rogue bots? Like rogue bots eating at his bandwidth mercilously are going to slow down, see User-agent: * Disallow: /… then turn around and leave.
7th December 2005 @ 06:49
-
9
I think it could be something to do with GoogleGuy not posting on it any more.
Perhaps he’s got his own blog now?
12th December 2005 @ 01:18
Copyright © 2004 - 2009 David Naylor. All rights reserved |
I love WMW as much as the next guy but I really think this was a boneheaded move. I hope they put a search feature in there soon.