Commit Graph
2 Commits
Author SHA1 Message Date
Greg Richardson 82f55217a2 feat(www): AI content via Content-Signal in robots.txt (#44875)
Add
[Content-Signal](https://www.ietf.org/archive/id/draft-romm-aipref-contentsignals-00.txt)
directive to robots.txt opting into AI training, search, and inference
use.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **Chores**
* Updated website and documentation robots.txt to enable AI training,
search indexing, and AI input processing for site content.
* Minor formatting fix: ensured trailing newline at end of both
robots.txt files.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2026-04-15 18:05:35 +00:00
Terry Sutton 59456e89aa Add robots.txt 2022-11-15 11:23:33 -03:30