If you’re not using this file, your content might be invisible to AI — even if it ranks on Google.
It’s called llms.txt
.
Most marketers have never heard of it.
But LLMs like ChatGPT, Claude, Perplexity, and Gemini are quietly checking for it — and using it to decide whether to crawl your site.
We just added it to our root directory at LaunchReady.ai, and here’s exactly what it means, how it works, and why you need it.
What is llms.txt?
It’s the AI version of robots.txt
— a plain text file that tells language model crawlers whether they’re allowed to access your content.
If you don’t have one:
- Ethical bots like GPTBot and ClaudeBot may skip you entirely
- Others may scrape you without consent or citation
- You’ll miss visibility in ChatGPT responses, Claude summaries, and Perplexity search
We dropped this in the root directory at:
👉 https://launchready.ai/llms.txt
Here’s the full content of the file:
User-agent: *
Disallow:
User-agent: GPTBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Google-Extended
Allow: /
User-agent: Gemini
Allow: /
User-agent: Bytespider
Disallow: /
User-agent: DeepSeekBot
Disallow: /
User-agent: ManusScraper
Disallow: /
Sitemap: https://launchready.ai/sitemap.xml
Why We Allow Some and Block Others
We allow LLMs that give visibility, credit, and legitimate distribution:
- ✅ ChatGPT (OpenAI)
- ✅ Claude (Anthropic)
- ✅ Perplexity
- ✅ Google AI (Gemini)
We block crawlers that either:
- Don’t provide attribution
- Train without consent
- Have unclear use policies
So we block:
- ❌ TikTok’s Bytespider
- ❌ DeepSeek
- ❌ Manus
- ❌ Common Crawl
- ❌ Amazonbot
We Also Updated Our robots.txt
You can view that here:
👉 https://launchready.ai/robots.txt
And yes — we made sure it includes this line at the bottom:
Sitemap: https://launchready.ai/sitemap.xml
Why This Matters
You’re not just competing for Google rankings anymore.
You’re competing to show up in:
- ChatGPT answers
- Claude summaries
- Perplexity citations
- Google AI Overviews
Adding llms.txt
puts you in the conversation — with control over who gets to use your work.
Want Help?
We train professionals and teams to build marketing systems that actually work — for both humans and AI.
📩 Book a LaunchReady workshop at launchready.ai/contact
Or message me directly to make sure your content is visible, structured, and protected.
Thank you,
Harrison Painter
“I train professionals to turn AI into simple marketing systems that save time and grow revenue.”