Generate llms.txt from docs corpus, include page descriptions, and expose per-page .md LLM routes

[Copilot]

llms.txt is now generated from the same docs source as llms-full.txt, but instead of embedding full content it links every docs page to a dedicated markdown endpoint. It now also includes a short per-page description, giving agents a lightweight index plus stable retrieval URLs with quick context.

• Scope

  • Replace static llms.txt content with a generated docs index.
  • Add one .md route per docs page URL.
  • Add a concise description for each indexed docs page in llms.txt.
  • Keep llms-full.txt behavior intact while refactoring shared logic.

• What changed

  • Introduced shared llms rendering/data utilities in src/app/llms/_lib.ts:
    • docs entry collection (/docs root + docs children)
    • shared rich-text-to-markdown rendering
    • .md URL mapping helper (/docs/... → /llms/docs/....md)
  • Refactored src/app/llms-full.txt/route.ts to consume the shared utilities without changing full-output semantics.
  • Reworked src/app/llms.txt/route.ts to emit:
    • link to /llms-full.txt
    • list of docs pages, each pointing to its own /llms/**/*.md endpoint
    • a short description per page (derived from the first meaningful sentence in rendered doc content)
  • Added dynamic per-page markdown route at src/app/llms/[...slug]/route.ts:
    • serves one docs page per request using the same renderer as llms-full.txt
    • parses .md suffix from the slug path
    • validates/decodes slug segments and returns 404 for invalid/non-doc paths
  • Updated generated links to same-origin paths to work correctly across preview environments.

• Example

  // llms.txt entry generation
  output.push(`- [${title}](${toLlmsMdPath(entry.url)}): ${description}`)
  
  // e.g. /docs/getting-started -> /llms/docs/getting-started.md

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
alineacms.com	Ready	Preview, Comment	May 20, 2026 2:20pm

[benmerckx]

@copilot The linked .md sub routes give a 404

[Copilot]

@copilot The linked .md sub routes give a 404

Fixed in a25e10c. The .md links in llms.txt are now same-origin, and the route was moved to src/app/llms/[...slug]/route.ts with explicit .md suffix parsing so /llms/**/*.md resolves correctly (verified with 200 responses for /llms/docs.md and /llms/docs/getting-started.md).

[benmerckx]

@copilot feedback from @cloetensbrecht:

Nu nog een description erbij en we zijn rond :)
https://alineacmscom-git-copilot-add-llms-route-alinea-cms.vercel.app/llms.txt

Iets als
Check: Configure a check field to input boolean data

[Copilot]

@copilot feedback from @cloetensbrecht:

Nu nog een description erbij en we zijn rond :)
...

Done in fae1126 (with main change introduced in 07e5e73). llms.txt now includes a short description after each docs link, e.g. - [Check](/llms/docs/configuration/fields/check.md): A check field is used to input boolean data. Screenshot of updated output: /tmp/llms-txt-screenshot.png.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

• alineacmscom-git-copilot-add-llms-route-alinea-cms.vercel.app
  • Triggering command: /home/REDACTED/.cache/ms-playwright/chromium_headless_shell-1187/chrome-linux/headless_shell /home/REDACTED/.cache/ms-playwright/chromium_headless_shell-1187/chrome-linux/headless_shell --disable-field-trial-config --disable-REDACTED-networking --disable-REDACTED-timer-throttling --disable-REDACTEDing-occluded-windows --disable-back-forward-cache --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-REDACTED-pages --disable-component-update --no-default-browser-check --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-features=AcceptCHFrame,AvoidUnnecessaryBeforeUnloadCheckSync,DestroyProfileOnBrowserClose,DialMediaRouteProvider,GlobalMediaControls,HttpsUpgrades,LensOverlay,MediaRouter,PaintHolding,ThirdPartyStoragePartitioning,Translate,AutoDeElevate --allow-pre-commit-input --disable-hang-monitor --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

• Configure Actions setup steps to set up my environment, which run before the firewall is enabled
• Add the appropriate URLs or hosts to the custom allowlist in this repository's Copilot coding agent settings (admins only)