Blog

Google Webmaster Tools and the Google Gap

by

Lots of excitement in the internet marketing world today (not least of all this office) as Google unveiled some fancy new features on Webmaster Tools.  At first glance it certainly does offer a lot more information regarding impressions and click through rates which is always very welcome of course:

However, dig a little deeper and compare the data that you are getting from WMT compared to other Google tools such as Analytics or the Keyword Tool and things start to get a little more confusing.

If we take the example of a keyword that Dave ranks well for – ‘csl sofas’ – and drill down further into the WMT figures we are told that between 15/03/2010 and 16/04/2010 Dave’s blog received 14800 impressions on that keyword. We can see that the in the last month the keyword got as high as #3 and dropped as low as #10 and Dave’s highest CTR was 1% when ‘csl sofas’ ranked between #3 and #4.

By adjusting the filters we can see that all of these impressions came via the web rather than from images etc

So far, so good. We’ve established that Dave’s blog ranks for ‘csl sofas’  and the site received 14800 impressions for this keyword – but how does this match up with the data we get from, say, the Google Keyword Tool? Well, an exact match search on ‘csl sofas’ tells us that in the UK in March 2010 there were approximately 22,200 searches on that keyword.

OK, so 22,200 searches a month on that exact phrase sounds reasonably plausible so I guess we can assume that Dave’s blog appeared in the organic listings for 66.6% of the searches made on that keyword…..? I’m a little confused now but never fear because Google Analytics will fill in the gaps and make it all clear for me, no?

Mmm, a search on organic traffic to Dave’s blog on between the same dates tells us that 142 people landed on his site via that exact phrase – as opposed to the 110 which Webmaster Tools tell us landed.

So, which data set are we to believe and – more importantly – which one do we trust to use to report back to our clients? The disparity between data from Google has been the subject of discussion for  years – it’s even got a name, ‘The Google Gap’ – and introducing new information just muddies the water even further. Are Google deliberately sending out confusing messages so that ultimately they are still the only ones that really have any idea of the real figures, and if so, why?

If we use this tool for anything it will be for discovering keywords that we rank for that we never knew we did – but I doubt very much we will rely on it for any kind of serious analytics.

23 Comments

  • Gary 1132 days ago

    Gary

    I found the ‘Gap’ between webmaster tools and GA to be quite small for the two blogs i have although the difference was always GA showing the higher figure

    Reply
  • therealkieran 1132 days ago

    http://www.anepinion.co.uk

    Another example of how analytics is best used to compare trends over time rather than absolute positioning?

    Still be nice for all the data to tie in though….

    Reply
  • Jim Gianoglio 1132 days ago

    http://www.lunametrics.com

    So far across the accounts I manage, I’ve seen the accuracy of the numbers vary wildly. Specifically, comparing the “click throughs” shown in WMT with actual visits reported in Google Analytics, I’ve seen them be spot on for some terms and hundreds off for others.

    Knowing that the clickt hrough data is often inaccurate makes me question the rest of the data too – that’s a shame. I’d love to hear more from Google about how they’re compiling the data.

    Reply
  • Killer Campaigning 1131 days ago

    http://www.killercampaigning.com

    I’m a fan of the new addition to Webmaster Tools; it helped me see right away that I should be focusing more efforts on a particular set of keyword phrases based on their click-through rate in the SERPS. I didn’t get this kind of data from Analytics.

    Reply
  • SEPo 1131 days ago

    http://www.webfinderpro.co.uk/

    I’m noticing huge differences between organic keywords in analytics and webmaster tools for the same period. These aren’t small differences either – as much as 750 clickthrus difference. Why the differences and which one should we believe ?

    Reply
  • Andrew@BloggingGuide 1131 days ago

    http://www.webuildyourblog.com

    I really hope that google would just lay it on the table, plain and simple.

    Reply
  • David Iwanow 1130 days ago

    http://www.davidiwanow.com

    Agree that their might be a gap and not all the amounts might add up, i see some useful data such as CTR unique for your listing along with what pages showed for that query. The only problem is that you don’t have as much control on your ranking so is it a tool that will help sell more adwords.

    The problem i can see with unrealistic clients is that they will just see the total possible and will use this new figure as gospel.

    One very interesting report is that terms some clients rank 1&2 received 54% & 11% of clicks…. so that might push up the fight to be ranked #1

    Reply
  • David Iwanow 1130 days ago

    http://www.davidiwanow.com

    just having a look at the data, and sometimes it matches and makes sense other times is just makes my head hurt…

    Reply
  • [...] Google Webmaster Tools and the Google Gap, davidnaylor.co.uk [...]

  • Crawl About 1130 days ago

    http://www.crawlabout.com

    If you want concrete numbers you can trust as far as searched keyword and visitors you can’t go passed your own log file.

    With each request the visitors browser supplies you with a previous page property in the http request headers. From this you can pull out the site (Google etc) and what the keyword search was for (q=XXX)

    This is all that Google Analytics is doing btw.

    A gap might also appear from an internal log file and GA from people having javascript disabled

    Reply
  • Linda van Berendonk 1128 days ago

    Note that the report used for this article is the “Keyword” report: this includes ALL search engines, not only Google. The data Google’s using for the WMT is ofcourse only Google data: that also causes differences ofcourse.

    The differences which I see, are actually pretty small! It depends on the keyword. The more a keyword is “branded” the more difference I see. This we can explain by the way a “click” is measured in WMT and a visit in GA….

    Reply
  • Andy 1127 days ago

    http://andybeard.eu

    When you consider navigational queries with absolute uniques, the GWT data becomes more & more logical.
    There are bugs in it, such as when the number of clicks in each position come to more than is listed for the total, but Google have no reason, in fact every reason not to fudge the numbers.

    Reply
  • David Iwanow 1126 days ago

    http://www.davidiwanow.com

    Actually some more thoughts about the data, and being how Google Analytics under reports visitors because of how it measures a bounce, it might be more accurate than Analytics.

    I recall stats of atleast a 1/3 of visitors don’t click and I read another 1/3 use the browser back button and go back to the results, so that complicates the GWT statistics…

    Reply
  • John T 1126 days ago

    Regarding Google keyword tool for the ‘last months’ search volume it is often a average of the previous 3 months before that, which could explain some of the disparity between WMT and Google keyword tool.

    Reply
  • Myke Black 1125 days ago

    http://www.mykeblack.com

    The disparity is most likely to be related to the source of the data. In the comparison to WMT and GA, you need to bear in mind that in WMT, the data comes from user interaction on the SERPS (hosted on googles servers), whereas in GA, the data is sourced from the javascript embedded in the page of the client’s website. There are many reasons why a click on a result in the SERPS might not lead to a corresponding recording of the embedded GA javascript back to google – some examples include SERPS screen scraping by SEO ranking tools, incomplete loading of the webpage (if someone clicks on the link but closes the browser before the target page is fully loaded), javascript disabled browsing platforms (either by security settings or by platform restrictions) to name but a few.

    What you report to the client should depend on what data they are interested in. If the client wants to know the number of referrals to their site from google, then you should use WMT. If the question is where their traffic comes from you should use GA (or for a more accurate picture, logging data from the webserver, which does not rely on javascript to generate data). Essentially the two questions are very similar, but with subtle differences.

    Reply
  • Paul 1124 days ago

    http://www.northsouthmedia.co.uk/

    Hi Carla, good article, I was wondering about the inconsitency before with GA data, I have another tracking software that works with js on my site and neither the two were ever the same.

    Some days, GA & GetClicky were close but on others there was a big gap, I also wondered if it was something to do with timezones as well, muddying the waters.

    Eventually, I had to concede that while I was getting the service for free, then I had to live with any anomalies that GA tracking software spits back at me.

    Clients need to understand that as well. If they really want concrete data, there gonna have to put their hands in their pockets.

    All of them still have GA running :)

    Reply
  • [...] I’ve heard speculation on the side of “nay”, and my own observations are worrisome. Some comparative research from Carla Marshall showed significant differences between the data provided by Webmaster Tools, [...]

  • Carla Marshall 1124 days ago

    http://www.bronco.co.uk

    @paul

    Don’t get me started on GetClicky, I can’t get on with that at all……

    Reply
  • Warner Carter 1123 days ago

    http://www.pageonebusiness.com

    the differences in keyword data across different tools drives me to distraction some days.

    Reply
  • Marc Lindsay 1123 days ago

    http://www.ltseo.com.au

    Now of course none of us work for google in this thread :D

    But you would have to question what google consider a “unique visitor” in analytics vs a unique visitor in webmaster tools, vs stats they are showing on the adwords tool.

    If I think of it like a business right….

    Google Adwords… Primary goal? Get more advertisers to spend more on traffic.

    Now….

    Adwords data is not ONLY Google search traffic, it is a combination of their network portfolio also remember, that alone will add to the incorrect numbers.

    Even further to this…. they want to show you great numbers, so what is their definition on this service to a unique visitor? It is not as important to have the unique visitor limited like they may in analytics, as its all about how many times you will be seen and of course clicked on.

    Analytics, this is going to be more on the unique visitors from a search engine point of view, though i believe its 30 days is the length someone is cookied for.

    Webmasters tools….. Who knows what they consider unique.

    140′ish vs 110…. pretty damn close and a good indication that they are giving accurate enough data to work with.

    This should let you map out rough traffic climbs between placements in your industry…. AND if that data could be combined with conversion…. now your cooking with gas.

    End of the day they are just numbers to read and evaluate.

    It’s annoying when working with clients for sure…. as you can never be accurate with adwords data :)

    Cheers for the read

    Marc

    Reply
  • Federico Caramella 1065 days ago

    http://spanishseoblog.blogspot.com

    Excellent post Carla!
    It makes me think a lot about Google statistics…

    Reply
  • jaap 1031 days ago

    http://www.traffic-builders.com

    I have to agree with Marc here. The keyword tool data is on the volume for the entire Google Search Network. So Search Partners are also included.This can be very confusing, in Holland where I am from we have some Craiglist like sites in the Searhc Partner Network making the data hard to interpret. My question is on the Webmaster Tools, is it using data for all Google domains in a country? F.E. Google.nl and Google.com have different SERPS here but are both used. What data is seen in WMT?

    Reply
  • [...] Google Webmaster Tools and the Google Gap [...]

Write your comment

Optional

The Bronco Family
Work With Us