June 2, 2005
Help Google Crawl Your site
Google is offering a new free service called Google Sitemaps where site owners can generate XML files of URLs they’d like crawled by google. The sitemap protocol allows for fields that specify change dates/frequencies but most interesting is the ability to give pages a relative “priority” to tell Google this is a page you find more important than another page. I can see the SEO optimizers drooling now.
Google, from their sitemaps help, states:
Google Sitemaps is an experiment in web crawling. Using Sitemaps to inform and direct our crawlers, we hope to expand our coverage of the web and improve the time to inclusion in our index. By placing a Sitemap-formatted file on your webserver, you enable our crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly.
Basically, the two steps to participating in Google Sitemaps are:
1. Generate a Sitemap in the correct format using Sitemap Generator.
2. Update your Sitemap when you make changes to your site.
They have also released a FAQ and group.
UPDATE: There’s a drop-in page for wordpress users.








emad said,
June 14, 2005 @ 8:07 am
a3rd party software page is now up on google code
Emad Fanous » Yahoo povides their crawling habits information to everyone said,
September 30, 2005 @ 6:19 am
[…] Unlike Google Sitemaps, they are actually showing you what they have crawled. Sitemaps, however, allows you to submit a list of URLs and will provide you with reporting information such as when Google picked up the info and if it was successful. Google doesn’t tell you, however, what was indexed…you also only see sites you submitted to google, privately. Yahoo’s information allows you to browse info about other sites. The closest thing to Google Sitemaps is a comment Yahoo has on their Submit Site page: You can also provide the location of a text file containing a list of URLs, one URL per line, say urllist.txt. We also recognize compressed versions of the file, say urllist.gz. […]
Mischief to Data » Blog Archive » Another very useful plug-in for helping Google crawl your site said,
October 28, 2005 @ 6:55 am
[…] Another very useful plug-in for helping Google crawl your site […]
kate said,
March 6, 2008 @ 9:59 am
cool post dude