home *** CD-ROM | disk | FTP | other *** search
/ Chip: 2005 Utilities / CHIP Utilities 2005.7z / CHIP Utilities 2005.iso / docs / discwiz / www.seagate.com / robots.txt
Encoding:
Text File  |  2001-03-14  |  428 b   |  17 lines
  1. # This is a file retrieved by spiders that 
  2. # conform to a defacto standard.
  3. # See <URL:http://info.webcrawler.com/mak/projects/robots/robots.html>
  4. #
  5. # The webmaster for this site is <webmaster@seagate.com>
  6. #
  7. # robots.txt for www.seagate.com  -- 010314 -- kevinw
  8.  
  9. User-agent: *
  10. Disallow: /cgi-bin     # Prevents CGIs from being indexed
  11. Disallow: /redirects  # Don't want to corrupt data
  12. Disallow: /images  
  13.  
  14.  
  15.  
  16.  
  17.