# $Id: robots.txt,v 1.20 2005/08/25 15:18:31 krusch Exp $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # Comments to the webmaster should be posted at # # Format is: # User-agent: # Disallow: | # ----------------------------------------------------------------------------- User-agent: * Allow: *.html Disallow: sitelog.html Disallow: cfinner.html Disallow: assearch.html Disallow: admin.html Disallow: /stats/ Disallow: /scriptswebmall/ Disallow: /imwebmall/ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.png$