3 # Copyright (c) 2002 by Martin Schulze <joey@infodrom.org>
5 # Sorry, only one crawler is allowed to index the mail archive.
6 # Traffic gets too high, making it too expensive for us. If
7 # it doesn't reduce, we'll have to shut down the service.
10 Disallow: /Mail-Archive/
11 Disallow: //Mail-Archive/
12 Disallow: /Linux/HOWTO/
14 # Google is our preferred search engine
18 # This is the Internet Archive archiver from web.archive.org
19 # User-agent: ia_archiver