# Disallow all crawlers access to certain pages. User-agent: * Allow: / Allow: /articles-news Allow: /cafe Allow: /contact Allow: /farm Allow: /market Allow: /media Allow: /menu Allow: /mission Allow: /pdf Allow: /sitemap Disallow: /articles-news/articledetail.asp Disallow: /articles-news/categorylist.asp Disallow: /menu/menudetail.asp Disallow: /articles-news/results.asp Disallow: /admin Disallow: /aspnet_client Disallow: /bin Disallow: /code Disallow: /css Disallow: /data Disallow: /graphics Disallow: /images Disallow: /includes Disallow: /js Disallow: /shop # Sitemap files Sitemap: http://www.foodandthought.com/sitemap.txt