# Revision ID: RG67300807 # # ------------------------------------------ # You are free to contact me for any reason. # seo@softdivision.com Attn: R0ss # ------------------------------------------ # # Please, do not crawl us faster than 1 hit/second. # If you need to examine many http://www.dobro.is pages, # please go to http://www.dobro.is/sitemap.xml # instead of crawling us. # # /////////// Information for SpEcIaL UsErS ///////////////// # # Hi boys, I'm the guard script [GS ver.1.6-a]! # You just browse robots.txt file @ dobro.is I know why # you are here :-). So, I already nmap all your details # and do SMTP, SMS to my boss! Don't make him angry! # # /////////// Information for SpEcIaL UsErS ///////////////// # User-agent: * # Disallow: / # go away Disallow: /admin/ # one attempt ONLY Disallow: /cgi-bin/ # one attempt ONLY Disallow: /download/ # for public use NOT for crawlers Disallow: /editor/ # for script use NOT for crawlers Disallow: /fco/ # for script use NOT for crawlers # Disallow: /images/ # for script use NOT for crawlers Disallow: /includes/ # for script use NOT for crawlers Disallow: /modules/ # for script use NOT for crawlers Disallow: /seo/ # for script use NOT for crawlers Disallow: /transport/ # for script use NOT for crawlers # Disallow: /calendar.html # for script use NOT for crawlers Disallow: /ver.txt # these will soon disappear # Sitemap: http://www.dobro.is/sitemap.xml # # Database of Web Robots # http://www.robotstxt.org/wc/active/html/index.html # # #