User-agent: WebReaper User-agent: wget User-agent: dragonfly Disallow: * User-agent: * Disallow: /cgi-bin/ Disallow: /irc/pics/ircpics/ Disallow: /img/ Disallow: robots.txt Disallow: /irc/wall/old/ Disallow: /irc/grimble/pinkfloyd.html Disallow: /irc/grimble/pinkfloyd-lynx.html Disallow: /irc/list/archives/ Disallow: /mail/ Disallow: /forums/ Crawl-delay: 5