# robots.txt for The Physician AI Handbook # https://physicianaihandbook.com User-agent: * Allow: / # Disallow internal/build files Disallow: /search.json Disallow: /_book/ Disallow: /.quarto/ # AI and LLM discovery # https://physicianaihandbook.com/llms.txt # https://physicianaihandbook.com/for-ai.json # https://physicianaihandbook.com/for-ai.txt # Note: LICENSE and search.html URLs return 410 Gone via serverless function # Don't disallow them - let Google crawl and see the 410 to remove faster # Sitemap location Sitemap: https://physicianaihandbook.com/sitemap.xml