Research notes

AI bot types — training, indexing, and retrieval bots do different jobs

Distinguish a crawler request from a sampled answer.

How to use it#

Agent analytics observes activity for domains connected to Kept Gateway. Prompt analytics examines sampled answers from supported AI surfaces. These are separate data sources.

What to check#

A crawler requesting a URL does not prove that it appeared in an answer. Investigate the crawl data and the cited answer independently.

Search titles, guides, and API references.