This file must be placed in your 'www' directory in order for a search engine to see it.

The sample below tells search engines not to index pages in the specified folders.


---- robots.txt  (contents follow)


User-agent: *

Disallow: /cgi-bin/

Disallow: /images

Disallow: /secret

Disallow: /members