44 lines 1 KiB Text
44 lines
1 KiB
Text
User-agent: Amazonbot | |
User-agent: anthropic-ai | |
User-agent: Applebot-Extended | |
User-agent: Bytespider | |
User-agent: CCBot | |
User-agent: ChatGPT-User | |
User-agent: ClaudeBot | |
User-agent: Claude-Web | |
User-agent: cohere-ai | |
User-agent: Diffbot | |
User-agent: FacebookBot | |
User-agent: facebookexternalhit | |
User-agent: FriendlyCrawler | |
User-agent: Google-Extended | |
User-agent: GoogleOther | |
User-agent: GoogleOther-Image | |
User-agent: GoogleOther-Video | |
User-agent: GPTBot | |
User-agent: ICC-Crawler | |
User-agent: ImagesiftBot | |
User-agent: img2dataset | |
User-agent: Meta-ExternalAgent | |
User-agent: OAI-SearchBot | |
User-agent: omgili | |
User-agent: omgilibot | |
User-agent: PerplexityBot | |
User-agent: PetalBot | |
User-agent: Scrapy | |
User-agent: Timpibot | |
User-agent: VelenPublicWebCrawler | |
User-agent: YouBot | |
User-agent: AhrefsBot | |
User-agent: BLEXBot | |
User-agent: Clickagy | |
User-agent: SemrushBot | |
User-agent: SemrushBot-BA | |
User-agent: SemrushBot-COUB | |
User-agent: SemrushBot-CT | |
User-agent: SemrushBot-SI | |
User-agent: SemrushBot-SWA | |
User-agent: SiteAuditBot | |
User-agent: SplitSignalBot | |
Disallow: / | |
|