# robots.txt for pga.lbl.gov, keep crawlers out of the database nightmare User-agent: * Disallow: /cgi-bin/