webmasterworld.com which recently banned all the search engine robots via it’s robots.txt file.. has been Removed completely in Google. Webmasterworld.com has not had a search function for quite a while and most people used Google to site search webmasterworld.com
DaveN
added : thread here on SEW about webmasterworld.com
Firewall Script I'm going to do a full write up on this, but I have been testing this out on a blog, that's been hacked and DDOS a few times over the last 6 months, why do people feel I want to host their Malware, why don't I just update WP time and effort I guess
Anyway I had been looking for a solution that i can install on a shared box that that I didn't have root access on.
Anyway My test is coming to an end, and I going to try and score a deal on a multiple domain license, or even try and buy a lump of the company lol
9 Comments | Leave a comment »
I love WMW as much as the next guy but I really think this was a boneheaded move. I hope they put a search feature in there soon.
Brett ain’t your born yesterday kid. The lack of search is going to stink, but will it be for long? Maybe he’s bought some Google search hardware. Or has something else up his sleeve.
I don’t use WMW much now that the DaveN, TW, & WG blogs are around, but it’d still be a shame to see it tank from this. Hope Brett’s got a plan.
I agree with comment 1. I thought that Brett was smarter than this… Unless it is purely to get more backlinks as people comment on the move, in which case he IS smarter than us all. That robots.txt will be changed back within no time, I would wager. I certainly don’t buy that it is to stop rogue robots because there are many, many solutions to that which could be explored and would be far more successful than this!
Maybe there is something we are missing? Does he know something we don’t?
Surely it can’t be such a simple mistake coming from a respected site as this.
Also, why has it dropped right away? Was there human intervention? Be interesting to see if anything filters out of Google the next few weeks regarding this.
I wonder if anyone will test this on one of their own sites unanounced to see how quick google removes them.
Certainly never a dull day on the Island of Search.
I really think that was a silly move to remove spider indexing. I guess we all have our own thing. I hope Brett changes his mind and fixes it…
Yeah, I think most are missing it. I think Brett is trying to save a sinking ship. I really don’t buy the story that the load is too high and robots.txt is the fix. I think its only a desperate attempt to keep newbies out so that the noise ratio goes down.
Too little too late.
Rogue bots? Like rogue bots eating at his bandwidth mercilously are going to slow down, see User-agent: * Disallow: /… then turn around and leave.
I think it could be something to do with GoogleGuy not posting on it any more.
Perhaps he’s got his own blog now?
;-)