AI Crawler Analytics

Monitor AI systems accessing your site and optimize for LLM discoverability.

Total AI Requests

...

Unique Crawlers

...

Avg Response Time

...

Pages Crawled

...

Requests by AI Crawler

Which AI systems are accessing your site

Most Crawled Pages

Which pages AI systems visit most

AI Discovery Endpoints

Endpoints that help AI systems discover and understand your site

AI Plugin Manifest

Standard AI plugin discovery manifest

/.well-known/ai-plugin.json

OpenAPI Spec

API specification for AI systems

/openapi.yaml

LLMs.txt

Human-readable guide for AI assistants

/llms.txt

AI Info

Machine-readable site information

/ai-info

Robots.txt

Crawler directives with AI bot rules

/robots.txt

AI Search Engine Submission Guide

Submit your site to AI search engines for better discoverability. Most AI crawlers work automatically based on robots.txt.

Google Search Console

Submit sitemaps and monitor Google indexing

Add property and submit sitemap.xml

Bing Webmaster Tools

Submit to Bing and Microsoft Copilot

Add site and submit sitemap

Perplexity

AI search engine - crawls automatically

No submission needed - ensure robots.txt allows PerplexityBot

You.com

AI search engine with webmaster tools

Submit site for indexing

ChatGPT/OpenAI

GPTBot crawls automatically based on robots.txt

No submission needed - ensure robots.txt allows GPTBot

Claude/Anthropic

ClaudeBot crawls automatically

No submission needed - ensure robots.txt allows ClaudeBot