Let's exclude some things
This commit is contained in:
parent
aa14594757
commit
1fa58f62dc
4
robots.txt
Normal file
4
robots.txt
Normal file
|
@ -0,0 +1,4 @@
|
||||||
|
User-agent: GPTBot
|
||||||
|
Disallow: /
|
||||||
|
User-agent: Google-Extended
|
||||||
|
Disallow: /
|
Loading…
Reference in a new issue