robots: Banned GPTBot off the website

This commit is contained in:
Yuki Joou 2023-08-11 02:12:35 +02:00
parent 4434d76dfb
commit 65e3e48e00

3
src/robots.txt Normal file
View file

@ -0,0 +1,3 @@
User-agent: GPTBot
Disallow: /
Allow: /ai.html