Tool Tip Tuesday – Your Browser and the Google Index (Part 1)

Often the best SEO tool is one that everyone in the world has access to, Google.com

Very often I’m asked to quickly do an SEO evaluation of a website.  Sometimes this might be 1 hour, sometimes 20 minutes and sometimes a few hours.  While we use a lot of tools here at Vizion Interactive, I have found that the best way to do this type of discovery is using the tools that are available to everyone; a good web browser (Firefox or Chrome), my brain (and the knowledge I have built up over the past 15-20 years), the website in question and the actual search engine indexes themselves (bonus if you have Google Search Console and Bing Webmaster Tools too).  In this article, I am going to impart some of the wisdom I have garnered over my experience working on, consulting for, marketing and building websites, specifically focusing on how to use what I would call “the most basic” of tools we all have in our tool kit.

First off, you need a real browser with some basic, built in tools (i.e., developer tools).  I prefer either of the 2 below, often using them both in conjunction with each other.

firefox chrome

Firefox                                  Chrome

If you are using IE as your primary browser, that is fine, but it won’t be as useful a tool for what I am going to discuss.  However, that said, IE is a great browser to use to navigate your own site from time to time so you can see if everything is working in it as expected.  Additionally, make sure you look at your analytics by browser type and version so you can potentially identify browser compatibility issues you and your team may miss from time to time.

Ok, let’s get started.  You should have downloaded both Firefox and Chrome now using the links above.  For the sake of fairness, I will do this exercise against our own website, VizionInteractive.com, to see what we can identify as issues…I mean opportunities to improve our very own website using just this basic tool kit.

My first step is the simplest:  Go to Google and perform a search query for “site:<your-domain.com>”.  This provides you a snapshot of what is in the index and, by not including the ‘www’, you see everything related to your domain that exists in Google.com’s index.  The key initial things I look at on this query are:

  • What is the number of results shown?
  • Do any URL patterns jump out at me to dig into further?
  • As I scroll through the pages of listings, what happens to the results number?
  • Do I see any sub-domain URLs showing up in the listings?
  • Is there consistency in the URLs and listings shown (i.e., are they all http, https, include www, not include www, end in trailing slash, have date stamps, have descriptive titles, do not have repetitive title or descriptions, etc.)?
  • Do any have a description calling out that they were “blocked by robots.txt”?
  • Do any of the URLs for the listings shown reference “page” or page numbers?
  • Are there inconsistencies in any of the listing causing them to stand out?
  • Do you see a lot of URLs with parameters in them and is that an expected thing?
  • Do a lot of your titles end in “…” and cut off more than just your brand name/URL mention?
  • Do you have “screaming” titles/description content (ALL CAPS) or do you refrain from this practice?
  • Are there “.pdf” files in the index or other similar document types of listings?
  • When you get to the end of the pages of listings for your site, do you see a link at the end calling out that there are additional URLs not shown?

 

tooltues1

Just in the first page of listings, I spotted a bunch of things listed above to make note of:

  • The initial search result listing count is 711
  • The homepage title is getting truncated
  • The blog has a distinct directory in the URL
  • There are pagination listings from the blog making it into the index

As I scroll through the pages just observing the listings in the search engine index and making notes, I also like to pay attention to the overall results count displayed at the top.  Sure enough, when clicking to page 4 of the results, the count mysteriously drops by 3 listings:

tooltues2

 

Additionally, at this point, I have spotted some other patterns to save for digging into later:

tooltues3

 

So, at this point, I’ve made notes about “/blog” and “/about-us” – we’ll get to those later.  As you go through the index, you’ll start to notice other patterns (hopefully if the site was built with purpose) and additional notes will be made of micro areas of the website to explore through the index.  Now, you will continue to see drops on the result count.  Interestingly, you may see huge drop-offs by the time you hit the final page of listings like this shows:

tooltues4

 

Seriously Google, a drop of over 400 page results, huh?  Interestingly, there is also no click to show suppressed results either.  So, to see how accurate this final number really is, I like to now add “&filter=0” to this final pages URL to see if the count changes.

tooltues5

 

Interestingly, that actually added a listing somewhere to the mix AND reshuffled the results.  Well, we’ll poke around at the micro-areas of the site to identify areas that really cause A) the listings count drop; and B) other areas of website opportunity.

Now, I have made notes around a variety of things I have spotted in Google.com’s index for VizionInteractive.com.  Now we use the index itself to get granular and try to understand which areas may be the cause of the 400+ results drop-off.

I called out a couple patterns throughout this, but let’s just show you the full list I compiled here:

  • /blog, /about-us, ?partners=, /digital-marketing-services, /blog/page, /about-us/testimonials, /digital-marketing-services/seo, /digital-marketing-services/content-marketing, /digital-marketing-services/social-media-marketing-services, /about-us/careers, /digital-marketing-services/ppc-management-services, /our-work

One thing I noticed was that there were no sub-domains, but in order to double check that I did a query for “site:vizioninteractive.com -www” and sure enough, Google missed something in that last set as I found the following:

tooltues6

 

Hmmm…I’ve been with Vizion by the time this is published now for about 6-7 months, I didn’t know we had a whole support area with forums, etc. out there…interesting.  Well, we add that sub-domain to the list of the microcosms of the VizionInteractive.com website to explore.

Now we explore the microcosms that we made notes about.  The list is now all of these:

  • /blog, /about-us, ?partners=, /digital-marketing-services, /blog/page, /about-us/testimonials, /digital-marketing-services/seo, /digital-marketing-services/content-marketing, /digital-marketing-services/social-media-marketing-services, /about-us/careers, /digital-marketing-services/ppc-management-services, /our-work, support.vizioninteractive.com

Well, support.vizioninteractive.com is pretty straight forward when we dig into it.  It is some currently unused functionality built into our site.  Interesting that it was indexed.  We’ll come back to that later.

Hitting the known “big” or “broad” sections of the site, we’ll start by digging in around /blog, /about-us and /digital-marketing-services.

 

tooltues7

 

tooltues8

 

tooltues9

 

Wow, looks like right off the bat we can see where Google dropped the listings count – specifically the /blog URLs/pages.  We also ended up identifying a few additional URL patterns we can drill into later on.  In the meantime, let’s just see what the count drop off is from the /blog pages listings and probably a very minor contribution from the other macro-micro areas:

tooltues10

 

Hmmm, looks like the /blog pages made up the majority of the disappearing listings.  Now, experience tells me that I think I know the actual culprit pages that are causing this, that and the fact that I don’t see any on the last page; /blog/page:

tooltues11

That seems a bit odd.  Google shows 8 listings, but some of them include “Part 43” and “Part 44”…I think we have identified something here.  Through a quick spot check of the actual site around the /blog/page/ URLs, we see that there are actually 47 pages around this AND that it looks like with a couple more posts, there will be 48.  Now, 48 pages does not make up enough to explain the original 400 results count drop, given we see 8 displayed and seem to only be missing 38 (yes, the math is right, don’t count page 1 as a listing because it doesn’t match the URL format of the rest of these).  So, using experience and the big squishy grey thing in my skull, I recall that we use WordPress for our blog and, through my experience with this platform, know that there are some specific pages that typically exist in this frame work that could be adding to the initial results counts, but are they indexed and/or even indexable?  First let’s confirm if they exist – here is the list I can think of to check on: categories, tags, authors.

Well, just looking at the actual blog paginated page, I can confirm the existence of /author and /category URLs.

tooltues12

But a check of the index nets us…

tooltues13

 

tooltues14

 

…zilch.

Well, that is interesting.  Could these relate to the ghost listing count?  Now that we have gone through an exercise in checking through the index gaining an understanding of what and how to look at things to identify potential areas for deeper diving, the next step is to start diving into the site itself in much more detail to see if we can identify what may be causing the interesting things we see in Google’s index.

Come back for Part 2 next month to see how we now take these observations and try to not only identify the potential causes, but also start to look at opportunities to improve the overall website’s organic footprint.