Probably doesn't really keep them out, but eh...
This commit is contained in:
parent
4489a5407c
commit
2f16cf4991
1 changed files with 4 additions and 0 deletions
|
@ -2,3 +2,7 @@ User-agent: GPTBot
|
|||
Disallow: /
|
||||
User-agent: Google-Extended
|
||||
Disallow: /
|
||||
User-agent: claudebot
|
||||
Disallow: /
|
||||
User-agent: meta-externalagent
|
||||
Disallow: /
|
||||
|
|
Loading…
Add table
Reference in a new issue