# Solvé robots.txt # https://solve.science User-agent: * Allow: / # Don't crawl preview / picker pages Disallow: /index.html Disallow: /home-a-apothecary.html Disallow: /home-b-lab-dark.html Disallow: /home-c-clinical.html # AI scrapers — opt out from training, allow citation User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://solve.science/sitemap.xml