ListoBot.
The crawler Listo uses to audit how visible your site is to AI answer engines.
About ListoBot
ListoBot is the web crawler operated by Listo. It runs GEO (Generative Engine Optimisation) audits on the sites our customers add to their account, checking the on-page factors that affect how AI answer engines (ChatGPT, Claude, Gemini, Perplexity) see you — indexability, structured data, content freshness, extractability, entity clarity and authority.
ListoBot only crawls sites at the request of the site's own owner or a Listo customer who has added the domain to their account. It is not a training crawler — it does not collect content to train AI models.
Crawler details
| User-Agent | ListoBot/1.0 (+https://listoai.co/bot) |
|---|---|
| Respects robots.txt | Yes |
| Crawl frequency | On demand when an audit runs, plus any schedule the customer sets (typically weekly or monthly). A single audit fetches up to ~100 pages, one at a time, with a polite delay between requests. |
| IP identification | By User-Agent today; a stable egress IP range for firewall allowlisting is available on request. |
| Contact | [email protected] |
Allowing ListoBot
ListoBot honours robots.txt. To allow it explicitly, add:
User-agent: ListoBot
Allow: /If your site uses a firewall or WAF, allowing the crawler by name in robots.txt alone may not be enough: many WAFs block by IP or behaviour before robots.txt is consulted. On Cloudflare, add a custom Skip rule that matches the User-Agent:
(http.user_agent contains "ListoBot")If you filter by IP, email us at [email protected] and we'll provide the audit's egress IP range to add to your allowlist.
About AI-crawler probes during an audit
To check whether your site is reachable by the AI systems Listo reports on, an audit also sends a small number of requests using the real User-Agents of AI crawlers — for example GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, Amazonbot and Google-Extended.
This is deliberate: it's how the audit detects whether your site is invisible to those systems. These requests are harmless, arrive in a short burst, and are part of normal audit behaviour — please don't treat them as an attack. If your firewall bans our IP over this burst, your audit results will be incomplete.
Opting out
If you don't want ListoBot to crawl your site, remove the domain from your Listo account or disallow it in robots.txt:
User-agent: ListoBot
Disallow: /