Added robots.txt to disallow GPTBot webcrawlet.

This commit is contained in:
Sugaryy_ 2023-08-08 11:48:31 +02:00
parent 1b328c1bdc
commit e122e5f186

2
src/robots.txt Normal file
View file

@ -0,0 +1,2 @@
User-agent: GPTBot
Disallow: /