# /robots.txt file for http://webcrawler.com/ # mail jason@idmstudio.co.za for constructive criticism User-agent: * Disallow: /_mmServerScripts Disallow: /_notes Disallow: /bm Disallow: /Bulk_mailer_script Disallow: /Connections Disallow: /Copy of bm Disallow: /DB Backup Disallow: /forum Disallow: /full_site Disallow: /images Disallow: /include Disallow: /info Disallow: /locations Disallow: /myadmin Disallow: /postcards Disallow: /sitemapgen Disallow: /store_locator Disallow: /webalizer Disallow: /yacht Disallow: /generator Sitemap: http://www.divearchipelago.com/sitemap.xml