Hello, will your applications develop LLMS.txt or another system for indexing in AI engines?
Helpdesk is open from Monday through Friday CET
#12053 – LLMS.txt
Hi
No, because LLMs.txt is not used by LLM to index content, so LLMs.txt does not have any purpose or use.
Indexinx in AI engines is done ... by SEO.
When you ask a question to ChatGPT, Gemini, Perplexity, Claude, etc the first thing they do is ... a search.
ChatGPT, Perplexity use Bing
Gemini uses Google of course
Claude use Brave search
So being indexed well by LLM requires you to do well in SEO. LLMs.txt do not help, no LLM use it.
Best regards,
Yannick Gaultier
https://weeblr.com | @weeblr
“But does adding to robots.txt something like
User-agent:
GPTBot
Disallow: /
ClaudeBot
Disallow: /
actually help with how current AI search engines handle the site?”
Hi
No, if you do that, you are blocking some of Claude and ChatGPT bots from accessing your site. If you want your site content to be accessed by AI crawlers, you should not block them in your robots.txt, just like you probably don't block google.
Best regards,
Yannick Gaultier
https://weeblr.com | @weeblr