#Example /robots.txt file
Sitemap: http://nti.co.nz/sitemap.gz

User-agent: *
Disallow: /logs
Disallow: /cgi-bin