News
Working notes on search, crawling and the data behind AI answers. Written from real projects, with sources.
ChatGPT GEO
What ChatGPT reads before it answers, what the citation studies show, and which GEO tactics have evidence behind them.
29 Aug 2026 · 6 min read
Gemini GEO
Query fan-out in Google's own words, the citation data, and the traffic numbers behind the claim that search is dying.
29 Aug 2026 · 5 min read
Perplexity GEO
The engine whose citations track Google rankings most closely, and the one with the most contested crawling record.
29 Aug 2026 · 4 min read
Claude GEO
The thinnest evidence base of the four engines. What Anthropic documents, what researchers established, and where nobody knows.
29 Aug 2026 · 4 min read
What Is Common Crawl
A free archive of the public web, published monthly since 2008. What a crawl contains and what it means for your site.
29 Aug 2026 · 8 min read
Common Crawl Rate Limit
The CDX index server is heavily rate limited. What triggers a block, how long it lasts, and the interface that has no limit.
29 Aug 2026 · 2 min read
Common Crawl Index
Two indexes cover the same crawls. One answers single lookups, the other scales to whole top-level domains.
29 Aug 2026 · 2 min read
Common Crawl Bot
CCBot reads robots.txt, publishes its IP ranges, and can be blocked in two lines. What that block does and does not reach.
29 Aug 2026 · 2 min read
Common Crawl Alternatives
No public archive replaces it outright. Four routes that cover most of what people use it for.
29 Aug 2026 · 2 min read