User-agent: * Disallow: /RealMedia/ads/ Disallow: /ads/ Disallow: /fcgi-bin/ipeclick.cgi/ Disallow: /event.ng/ Disallow: /html.ng/ Disallow: /click.ng/ Disallow: /image.ng/ Disallow: /search/ Disallow: /fax/ Disallow: /print/ Disallow: /send_form/ Disallow: /email.php/ Disallow: /print.php/ Disallow: /comments.php/ Disallow: /cgi-bin/ Disallow: /members/ Disallow: /admin.php/ Disallow: /_themes/ Disallow: /admin/ Disallow: /images/ Disallow: /includes/ Disallow: /themes/ Disallow: /blocks/ Disallow: /modules/ Disallow: /language/ Disallow: /tmp/ User-agent: linkwalker Disallow: / User-agent: crawl Disallow: / User-agent: LWP Disallow: / User-agent: lwp Disallow: / # go away