From 82f55217a2fb4fb283a3991fcb8b4270da824df8 Mon Sep 17 00:00:00 2001 From: Greg Richardson Date: Wed, 15 Apr 2026 12:05:35 -0600 Subject: [PATCH] feat(www): AI content via Content-Signal in robots.txt (#44875) Add [Content-Signal](https://www.ietf.org/archive/id/draft-romm-aipref-contentsignals-00.txt) directive to robots.txt opting into AI training, search, and inference use. ## Summary by CodeRabbit * **Chores** * Updated website and documentation robots.txt to enable AI training, search indexing, and AI input processing for site content. * Minor formatting fix: ensured trailing newline at end of both robots.txt files. --- apps/docs/public/robots.txt | 3 ++- apps/www/public/robots.txt | 3 ++- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/apps/docs/public/robots.txt b/apps/docs/public/robots.txt index ba960896a46..f29198889d2 100644 --- a/apps/docs/public/robots.txt +++ b/apps/docs/public/robots.txt @@ -1,3 +1,4 @@ User-agent: * Allow: / -Sitemap: https://supabase.com/docs/sitemap.xml \ No newline at end of file +Sitemap: https://supabase.com/docs/sitemap.xml +Content-Signal: ai-train=yes, search=yes, ai-input=yes diff --git a/apps/www/public/robots.txt b/apps/www/public/robots.txt index a2529d03fe7..08f1c578070 100644 --- a/apps/www/public/robots.txt +++ b/apps/www/public/robots.txt @@ -1,2 +1,3 @@ User-agent: * -Sitemap: https://supabase.com/sitemap.xml \ No newline at end of file +Sitemap: https://supabase.com/sitemap.xml +Content-Signal: ai-train=yes, search=yes, ai-input=yes