I sell a thing called AI discoverability. Getting a business known by the machines people ask instead of Google.

A week ago I found out my own website had been turning those machines away at the door. Every time. For as long as I can measure back.

Every check I own said the site was healthy.

I was shocked. And pissed, honestly, because I demand the best out of myself and I demand it for my clients.

Then I remembered nobody has a handbook for this, and my clients know this. That is why I love it, and it is why this work has to be done by somebody who loves it. A person who does not love it is never going to go knock on a door that nothing told them to check.

It took me about ten minutes to get from oh no, that sucks, how did that happen, to oh goody, let’s go research it and fix it.

Let me back up.

People talk about AI crawlers like there is one kind. There are not. Some read your site to teach the model, so that months later it knows who you are without going to look. Some show up because a person asked a question ten seconds ago. Some are building an index. Some are an AI running an errand for somebody.

I could not tell you the true number and I would not believe anyone who says they can. The companies add them and rename them and do not always announce it. On top of that, some share of what arrives wearing those names is not them at all. There is a robot in my own logs that claims to be Google. It is not Google. Not sometimes. Every time I have looked.

Set that one aside for now. It is next week.

The one I care about most is the slow one, the one that reads your site to learn and carries what it learned back into the machine, so that later, when a person asks, the answer is already sitting there.

That is the one my site was refusing.

I did not do it, it was not a setting I clicked, and it was happening a layer above anything I own, to every site I had on that setup, mine and my clients’ alike.

The block is not the story though. The story is why it took this long to see.

We have a tool that counts the robots reading our sites. I built it. It has counted thousands of visits and taught me things I could not have guessed. It never once mentioned this, and it never could have.

A robot that gets turned away does not leave a footprint. It does not show up as a problem. It shows up as nothing, and nothing looks exactly like nobody came.

I had a chart. The chart said zero. I read that zero as nobody wanted to come. It meant they came and could not get in.

Same zero. Opposite problem, opposite fix, and no way to tell which one you are holding, because the chart is built out of whoever made it through the door.

An empty room and a locked door look identical from the inside.

I keep thinking about the people staring at a quiet dashboard right now, deciding their business is not interesting enough. Some of them are right. Some of them have a locked door.

I found mine by hand. Nothing alerted me. I got suspicious about something else entirely, went and knocked on my own door pretending to be one of those robots, and it did not open. That is the second time in a month a person caught something none of my software caught.

Software is good at counting what happened. It is close to useless at noticing what did not. And most of what goes wrong in this work is a thing that did not happen.

So here is what changed.

Last week I said the fix was not another chart, it was somebody knocking. That is running now. It went in Thursday. It knocks on a schedule whether or not anything looks wrong, and it marks its own knocking, so we never count ourselves as a visitor.

Then we upgraded the hosting on our sites, so the door is mine to open.

I knocked again this morning. Three different robots, both sites. Every one of them got in, and every one got the same page you would get, down to the byte.

Whether that makes an AI say our names more often, I do not know yet. It has been three days. Ask me in September and I will tell you either way.

So if you are paying somebody for AI visibility, ask them two things.

How would you know if the machines could not reach me at all. Not whether they like me. Whether they can physically get in. If the answer is some version of we watch the numbers, the numbers cannot answer it, because numbers are made of arrivals.

Then ask the harder one. Of the ones that do get in, how many are who they say they are. I am still working on my own answer to that, and what I have so far is not comfortable. A name in a log is a name somebody typed. Anyone can type anything.

The first question has an answer today. A person goes and checks the door on a schedule, whether or not anything looks wrong.

Go knock on your own door. You might be surprised who cannot get in, and who can.

See you next Tuesday.

Nathan. Lefty Media Co, Kansas City.

Leave a Reply

Your email address will not be published. Required fields are marked *