Still on Selective Search Engine indexing

Two weeks ago I talked about a post on WebStraction’s blog about the new Yahoo Class Directive.

The blog has a very interesting insight about how content should be dealt with by the SE’s. On a recent post webstractions reinforced the idea that the Bots should be told what constitutes content within a webpage. By doing so we are assuming by default that webpages don’t have content, but in reality, isn’t the primary purpose of a webpage to provide content?

I don’t necessarily agree with this concept.
So as far as I’m concerned, it makes a lot more sense to filter out what we don’t want indexed then the opposite,

On a more technical aspect Webstractions proposes the usage of the robots tag with new elements present and defined in an attribute within the tag. Very interesting read.

WebStractions Selective Page Indexing Directives

Share and Enjoy:
  • Print this article!
  • Digg
  • Sphinn
  • del.icio.us
  • Facebook
  • Mixx
  • Google Bookmarks

One Response to “Still on Selective Search Engine indexing”

  1. WebStractions June 10th, 2007 at 8:11 am

    Technically speaking, the introduction of a <ROBOTS REL=”directives”> tag can accommodate both of our viewpoints. The directives are simple and follow the same methods used in the ROBOTS meta-tag for the Head section — INDEX, NOINDEX, FOLLOW, NOFOLLOW.

    Instead of the INDEX directives, we would create the CONTENT and NOCONTENT. This way you can markup your page in the way that you deem easier — or more logical to you.

    And congratulations on your marriage! Got any pics of the unlucky bride? ;-)

Leave a Reply