chore(docs): remove llms-txt-disabled edge config handling

[devin-ai-integration]

Fixes FER-

Short description of the changes made

Removes the llms-txt-disabled edge config flag to enable llms.txt for all domains by default. This removes:

• isLlmsTxtDisabled from the EdgeFlags interface and defaults
• The flag from the EDGE_FLAGS array in edge config
• The 404 check in the llms.txt route handler that blocked disabled domains

What was the motivation & context behind this PR?

Per request from kenny, we want to enable llms.txt for everyone rather than having a blocklist. The edge config entry "llms-txt-disabled": ["composio"] will no longer be read by the code.

How has this PR been tested?

• Lint checks pass (pnpm lint:biome)
• Existing tests updated to remove the flag reference

Human review checklist

• Confirm enabling llms.txt for all domains is the intended behavior
• Note: The Promise.all in route.ts still calls getEdgeFlags(domain) but no longer uses the result - this keeps the auth config call but could be cleaned up in a follow-up if desired

---

Link to Devin run: https://app.devin.ai/sessions/1c546fd2276448c7b31941f5035496e6
Requested by: kenny@buildwithfern.com

[devin-ai-integration]

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

• Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
• Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

• Disable automatic comment and CI monitoring

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Updated (UTC)
dev.ferndocs.com	Ready	Preview	Nov 26, 2025 5:01pm
fern-dashboard	Ready	Preview	Nov 26, 2025 5:01pm
fern-dashboard-dev	Ready	Preview	Nov 26, 2025 5:01pm
prod-assets.ferndocs.com	Ready	Preview	Nov 26, 2025 5:01pm
prod.ferndocs.com	Ready	Preview	Nov 26, 2025 5:01pm

1 Skipped Deployment

Project	Deployment	Preview	Updated (UTC)
fern-platform	Ignored		Nov 26, 2025 5:01pm

[github-actions]

🌱 Smoke Test Preview

Testing branch changes with smoke test content:

• Smoke Test Content (from FDR): https://smoke-test-preview-74d2abb6-5438-487e-81ab-f8b03ac207b6.docs.buildwithfern.com
• Branch's Docs Platform (Vercel): https://prodferndocscom-git-devin-1764175850-remov-3050a8-buildwithfern.vercel.app/api/fern-docs/preview?host=smoke-test-preview-74d2abb6-5438-487e-81ab-f8b03ac207b6.docs.buildwithfern.com

🕷️ Smoke Test Crawler Results

Pages crawled: 33
Successful: 33 ✅
With errors: 0

🎉 All pages loaded successfully with no errors!