For whatever reason you decide you need to get a list of all of the urls you have on your website. In my case, I am looking to move a major site to a new platform and the urls will change. I need a list of all of the pages on the site so I can get a jump on my 301 redirects. You turn to Google, specifically Google Webmaster Tools and Google Analytics. You look around for it forever, but do not find it, even though this is exactly what you think Google Webmaster Tools and Google Analytics should do. It’s a task you need done, and clearly Google does have a list of all of the urls it has linked on your site.
It’s not there. It should be, but it isn’t. No idea why they left out that feature. It would be a vast boon to the world of internet marketing, search engine optimization and keyword research if they did such a thing, but they do not.
You can run a special query, specifically the one listed below which will simply return a paginated list (sadly not in excel spreadsheet form) of every page on your site.
site:digitaltoolfactory.net inurl:digitaltoolfactory.net -.pdf
That’s it! It’s not the most convenient thing in the world, but it gets the job done.
||Written By Steve French|