# Disallow all crawlers access to certain pages User-agent: * Disallow: /cgi Disallow: /stats Disallow: /_db_backups Disallow: /cs/admin #Disallow: /js Disallow: /manage_site Disallow: /php Disallow: /store/admin Disallow: /store/cache Disallow: /store/docs Disallow: /store/download Disallow: /store/editors Disallow: /store/email Disallow: /store/extras Disallow: /store/media Disallow: /store/pub Disallow: /support/admin Disallow: /bus/ #Disallow: /html/ #Disallow: /resources/videos/ Disallow: /resources/apps/ #Disallow: /assets/video/ # Sitemap files Sitemap: http://www.biolet.com/sitemap.xml