User-Agent: * Disallow: /*.php$ Disallow: /*.php7$ Disallow: /wp-content Disallow: /wp-includes Disallow: /wp-admin User-Agent: AhrefsBot Crawl-delay: 10 User-Agent: AI2Bot User-Agent: Amazonbot User-Agent: amazon-kendra User-Agent: anthropic-ai User-Agent: Applebot User-Agent: Applebot-Extended User-Agent: AwarioRssBot User-Agent: AwarioSmartBot User-Agent: Brightbot User-Agent: Bytespider User-Agent: ChatGPT-User User-Agent: ClaudeBot User-Agent: Diffbot User-Agent: DuckAssistBot User-Agent: FacebookBot User-Agent: FriendlyCrawler User-Agent: Google-Extended User-Agent: GPTBot User-Agent: iaskspider/2.0 User-Agent: ICC-Crawler User-Agent: img2dataset User-Agent: Kangaroo Bot User-Agent: LinerBot User-Agent: MachineLearningForPeaceBot User-Agent: Meltwater User-Agent: meta-externalagent User-Agent: meta-externalfetcher User-Agent: Nicecrawler User-Agent: OAI-SearchBot User-Agent: omgili User-Agent: omgilibot User-Agent: PanguBot User-Agent: PerplexityBot User-Agent: Perplexity-User User-Agent: PetalBot User-Agent: PiplBot User-Agent: QualifiedBot User-Agent: Scoop.it User-Agent: Seekr User-Agent: SemrushBot-OCOB User-Agent: Sidetrade indexer bot User-Agent: Timpibot User-Agent: VelenPublicWebCrawler User-Agent: Webzio-Extended User-Agent: YouBot Allow: /llms.txt Sitemap: https://www.beyondaitools.com/sitemap.xml