Does anyone have any empirical evidence that llms.txt makes any difference?
I've had multiple marketeers try to convince me that it's a must for a website, but the best "proof" they could give me were some LinkedIn posts from other marketing consultants.
I've tried replicating a scenario where Claude/ChatGPT would look for this file, but without luck.
Only one data point, but I get a lot of submissions for my newsletter from agents. Months ago, I updated llms.txt to include specific instructions for submissions that differ from what you can figure out from the human site, and I haven't seen a single one follow the rules in llms.txt yet. I can't say I've noticed any of my own agents looking for them either when just reading normal pages is a bread-and-butter task for them now.
This is one of the worst pieces of unedited LLM slop I've seen yet. At least read what it outputs instead of doing 1 sentence prompt -> ctrl+c ctrl+v -> publish...
Does anyone have any empirical evidence that llms.txt makes any difference?
I've had multiple marketeers try to convince me that it's a must for a website, but the best "proof" they could give me were some LinkedIn posts from other marketing consultants. I've tried replicating a scenario where Claude/ChatGPT would look for this file, but without luck.
Only one data point, but I get a lot of submissions for my newsletter from agents. Months ago, I updated llms.txt to include specific instructions for submissions that differ from what you can figure out from the human site, and I haven't seen a single one follow the rules in llms.txt yet. I can't say I've noticed any of my own agents looking for them either when just reading normal pages is a bread-and-butter task for them now.
This post would have made sense ~10 months back.
This is one of the worst pieces of unedited LLM slop I've seen yet. At least read what it outputs instead of doing 1 sentence prompt -> ctrl+c ctrl+v -> publish...
Why on earth would you make an MCP to let agents query your docs specifically?
We’ve moved well past that, and even when docs MCPs were the best approach, everyone just used context7 or similar.
[flagged]
[flagged]