chore: add robots.txt with AI crawler policy - #694

Open

fredericsimard wants to merge 4 commits into

mainfrom

chore/add-robots-txt/2026-07-24

Commits on Jul 24, 2026

chore: add robots.txt with AI crawler policy

fredericsimard
and
claude
committed
chore: allow all crawlers in robots.txt

fredericsimard
and
claude
committed
chore: set Content-Signal ai-train=yes in robots.txt

fredericsimard
and
claude
committed

Commits on Jul 26, 2026

Update robots.txt to include Sitemap
fredericsimard
authored