Google ignores Bings robots.txt ?

by David Naylor
See Dave Speak SMX London

Today while doing some keyword research in Google I came across a Bing search listing ranking at #11 for a competitive term, which is odd due to the fact that Bing blocks spiders to those pages !!

bing robots

but when I did a site:bing.com/search

bing_pages_indexed

so why is google indexing these pages and should bing just drop the robots.txt file and give google what it wants ?, of course these pages are not truly indexed as a few people on twitter has pointed out to me, but 11,000 + pages from links pointing at those pages that Google is allowed to spider ??

DaveN

Making your inbox more interesting
Looking to keep up to date, or find out those things we can’t mention on the blog? Then sign up to our semi-regular newsletter. Don’t worry, we won’t spam you.

18 Comments

Get in Touch

Things are better when they’re made simpler. That’s why the David Naylor blog is now just that; a blog. No sales pages, no contact form - just interesting* info about SEO.

If you’d like to find out more about the Digital Marketing services we do provide then head over to Bronco (our main company website) to get in touch.

Get in Touch Today * Interestingness not guaranteed
Part of the Bronco family