Open or Closed: The Decision You Didn’t Know You Were Making
Right now, publishers are making one of the most important decisions about their future — without realising they’re making it.
And in doing so, they’re deciding what the rest of us get to see — and what we don’t.
It’s not happening in strategy meetings. Not in boardrooms. It’s happening in files most people have never heard of: robots.txt, ai.txt, llms.txt, JSON-LD.
I’ve worked with publishers for a long time. And like most people in this industry, I’ve watched the traffic change. It didn’t disappear — people didn’t stop being curious about the world. But it went somewhere else. To AI. People started asking questions and getting answers directly, without ever arriving at a publisher’s website.
I wanted to understand what that means in practice. How do you become the answer? What does it take? And what are publishers around the world actually doing about this right now?
So over the last four months I’ve been doing the research — looking at close to 5,000 publisher domains across 99 countries, analysing whether they have AI policies, how they’re configured, whether their doors are open or closed to AI systems, and whether any of it looks like a deliberate choice or just a default nobody has revisited.
What I found was interesting. And a little uncomfortable.