Performance Blog

Google Updates Webmaster Central Adds robots.txt Feature

by Kent Schnepp | August 16, 2007

According to the official Google Webmaster Central Blog, Google has improved the robots.txt analysis tool. These improvements include the ability to recognize sitemap declarations and relative URLs.

Google states:

Earlier versions weren’t aware of sitemaps at all, and understood only absolute URLs; anything else was reported as Syntax not understood. The improved version now tells you whether your sitemap’s URL and scope are valid. You can also test against relative URLs with a lot less typing.

What does this mean?

  1. Google Webmaster Central now indicates whether sitemap’s URL and scope are valid.
  2. Overall reporting has been improved. Now you will alerted of multiple problems.

Leave a Reply





You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

By submitting a comment here you grant EngineWorks a perpetual license to reproduce your words and name/web site in attribution. Inappropriate or irrelevant comments will be removed at an admin's discretion.