Added robots.txt to disallow GPTBot webcrawlet.
This commit is contained in:
parent
1b328c1bdc
commit
e122e5f186
1 changed files with 2 additions and 0 deletions
2
src/robots.txt
Normal file
2
src/robots.txt
Normal file
|
@ -0,0 +1,2 @@
|
|||
User-agent: GPTBot
|
||||
Disallow: /
|
Loading…
Reference in a new issue