# Allow all crawlers, but restrict sensitive or low-value pages User-agent: * Disallow: /octopi-watch Disallow: /sign-in # Allow everything else Allow: / # Host Host: www.octopi.ai #Sitemaps Sitemap: https://www.octopi.ai/sitemap.xml