Build a spec-compliant llms.txt for your website in 30 seconds. We crawl your homepage and sitemap, categorize your content, and output Markdown you can edit, validate, and deploy.
Crawls homepage + sitemap.xml. Selects up to 60 links across categories. Cached 24h.
llms.txt is an emerging open standard for helping LLMs understand your website. It is a single Markdown file at the root of your domain that lists your most important pages in a curated, AI-friendly format.
Think of it as the AI-era equivalent of sitemap.xml, but designed for ChatGPT, Perplexity, and Claude instead of Googlebot. Major companies including Anthropic, Stripe, and Mintlify already publish llms.txt files.
This generator builds a spec-compliant file in 30 seconds by crawling your homepage and sitemap, then organizes the output by content type.
Optimize every layer of AI search visibility.
Does your keyword trigger a Google AI Overview? See the answer and cited sources.
Run real prompts through ChatGPT and benchmark brand visibility vs competitors.
Every PAA question Google shows for a keyword, with answers and source URLs.
Score any URL 0-100 for AI search readiness with embeddable badge.
Validate your llms.txt against the official spec — 12 rule checks.
Generate JSON-LD bundles optimized for ChatGPT and Perplexity citation.
Paragraph-level AI citability heat-map with rewrite recommendations.
Run real queries through ChatGPT, Perplexity, and Gemini and check citations.
Everything to know about llms.txt and generation.
llms.txt is an emerging open standard (proposed by Jeremy Howard) that helps AI engines like ChatGPT, Perplexity, and Claude understand your website structure. It is a Markdown file at /llms.txt that lists key URLs in a curated format optimized for LLM consumption.
It fetches your homepage and your sitemap.xml (if available), extracts all internal links, categorizes them by URL pattern (Documentation, Product, Blog, etc.), and outputs spec-compliant Markdown. You can edit the output before downloading.
Upload llms.txt to the root of your domain so it is accessible at yoursite.com/llms.txt. The file should not be inside any subfolder. WordPress sites can use FTP or a static-files plugin; Webflow/Framer/Wix have built-in static file or redirect features.
Not every page — that would make the file too long for AI engines to ingest efficiently. The tool intelligently selects up to 60 links across categories, prioritizing your most important content (Documentation, Product, Free Tools, Blog). Edit the output to add or remove links.
For larger sites, yes. llms-full.txt is the verbose companion that lists everything. llms.txt is the curated version. AI engines prefer the curated file but will fall back to the full file if needed.
Re-generate every 1-3 months or whenever you publish significant new content sections. AI crawlers re-fetch the file periodically (typically every 1-7 days for major sites).