Skip to content

Discoverability basics: llms.txt, canonical and sitemap fixes, footer, metadata, market-maker section - #101

Open
quintuskilbourn wants to merge 1 commit into
BuilderNet:mainfrom
quintuskilbourn:seo-basics
Open

Discoverability basics: llms.txt, canonical and sitemap fixes, footer, metadata, market-maker section#101
quintuskilbourn wants to merge 1 commit into
BuilderNet:mainfrom
quintuskilbourn:seo-basics

Conversation

@quintuskilbourn

@quintuskilbourn quintuskilbourn commented Sep 8, 2026

Copy link
Copy Markdown

Small additions to make the docs easier to find and to cite. Nothing existing is rewritten or removed, and the priority-updates section of the API reference is not touched (#100 covers it).

Changes

  • llms.txt and llms-full.txt, generated at build time by docusaurus-plugin-llms (dev dependency). 28 documents, blog included.
  • trailingSlash: false, matching vercel.json. The docs index canonical was https://buildernet.org/docs/, which redirects to /docs; the sitemap listed the same URL. Both now use /docs.
  • /search dropped from the sitemap. It is a noindex page, but the theme writes the tag as property="robots", which crawlers ignore, so listing it in the sitemap was contradictory.
  • robots.txt with a User-agent / Allow block in front of the sitemap line.
  • Footer with links to the main pages (send orderflow, priority updates, refunds, API reference, architecture, operating a node, forum, Telegram, GitHub).
  • Organization JSON-LD in the head.
  • Meta descriptions rewritten to say what the page is for: API reference, send orderflow, how to participate, refunds, what is BuilderNet, the homepage, the encryption page (was "coming soon"), historic measurements (had none), the blog (was "Blog").
  • "Market makers (propAMMs)" section on How to participate. The API reference already points there for API keys, but the page had nothing for market makers. The quote stream is also listed under supported methods on How to send orderflow.
  • Homepage: an intro paragraph and a row of cards for searchers, wallets, propAMM market makers and node operators.
  • Alt text on the six images without it. Historic measurements added to the sidebar (it was only reachable by URL). Priority Update Registry repo added to Resources.

Not changed

  • Pre-existing broken anchors that the build warns about (the refund method anchors on /docs/api, and /docs/api#Refunds on /docs/refunds).

Follow-ups outside this repo

  • www.buildernet.org has no DNS record. A CNAME or redirect to the apex would catch links that use it.
  • Verify buildernet.org in Google Search Console (DNS TXT record). Vercel Web Analytics is already wired in via src/theme/Layout.
  • Last-updated dates on pages need showLastUpdateTime: true plus VERCEL_DEEP_CLONE=true in the Vercel project; with a shallow clone every page would show the build date.
  • GitHub: set the homepage field on flashbots/rbuilder and flashbots/priority-update-registry, and give the latter a description. Neither links here today.

Testing

yarn build with the production URL. Checked llms.txt, llms-full.txt, sitemap.xml (31 URLs, /docs without a trailing slash, no /search), robots.txt, the canonicals on /, /docs and /docs/api, the JSON-LD block, the footer, the new section and cards, and that every new internal link resolves.

🤖 Generated with Claude Code

https://claude.ai/code/session_01KC52TzZ4W7Un4SxwUwq7k9

@vercel

vercel Bot commented Sep 8, 2026

Copy link
Copy Markdown

@quintuskilbourn is attempting to deploy a commit to the Flashbots Team on Vercel.

A member of the Team first needs to authorize it.

@quintuskilbourn
quintuskilbourn force-pushed the seo-basics branch 4 times, most recently from f9ac624 to 4b0a0b3 Compare September 8, 2026 19:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant