# This file implements the "robot exclusion protocol". It tells robots # such as web crawlers and other search engines not to proceed below # the root of this database. # See # http://info.webcrawler.com/mak/projects/robots/norobots.html # for a description of the robot exclusion protocol and more information # on how this file works. User-agent: * allow: / Disallow: /*.pdf$ Disallow: /*.ppt$ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /website/preview/ Disallow: /website/ctlg_PDF/ Disallow: /website/CONTENTS/ Disallow: /website/images/ Disallow: /website/SilverStream/