🛠️ upd: robots.txt (#241)

* add robots txt * Update docs/public/robots.txt Co-authored-by: Kevin Z <[email protected]> * Update robots.txt --------- Co-authored-by: Kevin Z <[email protected]>
GlobeMC · Mar 7, 2024 · 8e56284 · 8e56284
1 parent 45b2fc2
commit 8e56284
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/docs/public/robots.txt b/docs/public/robots.txt
@@ -0,0 +1,6 @@
+User-agent: *
+Allow: /
+Disallow: /*.html
+Disallow: /_auth_redirect
+Disallow: /log-viewer
+Sitemap: https://crashmc.com/sitemap.xml