How to get a list of the pages Google has indexed on your site How to get a list of the pages Google has indexed on your site

How to get a list of the pages Google has indexed on your site

The Problem

'Google Search Coupon: 1 FREE Google Search' photo (c) 2008, Bram Van Damme - license: http://creativecommons.org/licenses/by/2.0/For whatever reason you decide you need to get a list of all of the urls you have on your website.  In my case, I am looking to move a major site to a new platform and the urls will change.  I need a list of all of the pages on the site so I can get a jump on my 301 redirects.  You turn to Google,  specifically Google Webmaster Tools and Google Analytics.  You look around for it forever, but do not find it, even though this is exactly what you think Google Webmaster Tools and Google Analytics should do.  It’s a task you need done, and clearly Google does have a list of all of the urls it has linked on your site.

The Cause

It’s not there.  It should be, but it isn’t.  No idea why they left out that feature.  It would be a vast boon to the world of  internet marketing, search engine optimization and keyword research if they did such a thing, but they do not.

The Solution

You can run a special query, specifically the one listed below which will simply return a paginated list (sadly not in excel spreadsheet form) of every page on your site.

site:digitaltoolfactory.net inurl:digitaltoolfactory.net -.pdf

That’s it!  It’s not the most convenient thing in the world, but it gets the job done.

In the interest of full disclosure, I did not search Bing or Open Site Explorer to look for a list.

 

Written By Steve French

 

One response to “How to get a list of the pages Google has indexed on your site”

Leave a Reply

Your email address will not be published. Required fields are marked *






Copyright 2011 Digital Tool Factory. All Rights Reserved. Powered by raw technical talent. And in this case, WordPress.