Blog
What we find in real search data, and why the product works the way it does. Every number comes from a run we can point at.
- 2 min readAEOrobots.txt
Which AI crawlers to allow, and what each one actually does
Blocking GPTBot does not keep you out of ChatGPT's answers, and blocking OAI-SearchBot does. The two get confused constantly, and one of them costs you citations.
Read it - 2 min readProductOn-page
Why we refuse to score your page out of 100
A weighted score puts a missing language attribute and a noindex tag on the same scale. Counting checks is less impressive and more useful.
Read it - 2 min readIndexingCase study
We asked Google about 2,181 pages one by one. 64% were unknown to it
Search Console's coverage report samples. The URL Inspection API answers for a specific page. The gap between the two is where a sitemap quietly dies.
Read it