From e122e5f186cb5910c9fd426cd6486b7549d890e3 Mon Sep 17 00:00:00 2001 From: Sugaryy_ Date: Tue, 8 Aug 2023 11:48:31 +0200 Subject: [PATCH] Added robots.txt to disallow GPTBot webcrawlet. --- src/robots.txt | 2 ++ 1 file changed, 2 insertions(+) create mode 100644 src/robots.txt diff --git a/src/robots.txt b/src/robots.txt new file mode 100644 index 0000000..b7ccd81 --- /dev/null +++ b/src/robots.txt @@ -0,0 +1,2 @@ +User-agent: GPTBot +Disallow: / \ No newline at end of file