ChatGPT Agent
OpenAI uses this crawler to open pages on a user's behalf inside AI tools. Browses the web on a user's behalf during ChatGPT agent tasks.
What is ChatGPT Agent?
Browses the web on a user's behalf during ChatGPT agent tasks. Agent crawlers browse the web on a user's behalf inside AI tools: opening pages, reading documentation, and completing tasks. Traffic arrives from engaged users who asked for exactly what you offer. Blocking agents does not protect content from training, but it does cut off this kind of high-intent visit.
Allowing it keeps your site reachable to AI agents acting for users — an emerging traffic channel worth keeping open.
Does ChatGPT Agent respect robots.txt?
Yes. ChatGPT Agent honors robots.txt directives, including wildcard rules and Allow lines. A Disallow rule for this crawler is respected — but remember robots.txt is a voluntary protocol across the whole industry, not a wall.
How to block ChatGPT Agent
Add this group to your robots.txt to deny ChatGPT Agent across your whole site:
User-agent: ChatGPT Agent Disallow: /
Blocking it stops agent-driven visits but provides no real content protection, since agents only fetch pages the user asked for.
How to allow ChatGPT Agent
ChatGPT Agent is allowed by default on every site. It only gets blocked if a matching rule exists — most often a global User-agent: * group with Disallow: /. To exempt it while blocking other bots, put an empty Disallow group for it before the global block:
User-agent: ChatGPT Agent Disallow: User-agent: * Disallow: /
Is ChatGPT Agent currently allowed on your site?
Paste your robots.txt into the free auditor and see verdicts for all 61 AI crawlers — including the specific paths that matter.