How to Track AI Bot Traffic on Any Website in Minutes (with xSeek + Edgely)
See exactly which AI agents — GPTBot, ClaudeBot, PerplexityBot and more — are visiting your site. Connect xSeek to Edgely in two clicks and get automatic AI traffic analytics without touching your code.
TL;DR — Quick Answer
Add your xSeek API key and website ID to any Edgely domain and every AI bot visit — GPTBot, ClaudeBot, PerplexityBot, and 20+ others — is automatically recorded in your xSeek dashboard. No embed script, no code changes, works on any platform.
Why AI Bot Tracking Matters for Your Website
GPTBot, ClaudeBot, PerplexityBot, Gemini, and dozens of other AI crawlers are systematically indexing the web to power next-generation AI search engines and LLM training datasets. [1] If your site appears in AI-generated answers — or could — knowing which AI agents visit, how often, and what they read is the foundation of any Generative Engine Optimisation (GEO) strategy. [2]
The problem: traditional web analytics tools (Google Analytics, Plausible, Fathom) track JavaScript-executing browsers. AI bots rarely execute JavaScript. They fetch raw HTML and move on — leaving no trace in your analytics dashboard.
xSeek solves this at the network layer. And with Edgely, connecting it to any website takes two minutes — no code changes required.
How Edgely + xSeek Works
Edgely is a reverse proxy that sits in front of your website, serving it on your custom domain. Every HTTP request — from real users and AI bots alike — passes through Edgely's edge middleware before reaching your origin.
When you connect xSeek, Edgely's middleware:
- Inspects the
User-Agentheader of every incoming request. - Detects known AI bot signatures (GPTBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, Gemini, CCBot, Bytespider, YouBot, and 15+ more).
- Sends a fire-and-forget tracking event to xSeek's API — without adding any latency to the proxied response.
- Logs the bot name, URL visited, IP, and referrer to your xSeek dashboard.
This all happens at the proxy layer. Your origin server and your website's code are completely untouched. [3]
Step-by-Step: Connect xSeek to Any Website via Edgely
Prerequisites
- An Edgely account (free) with at least one domain configured.
- An xSeek account — create a website in the xSeek dashboard to get your API key and website ID.
Step 1 — Get your xSeek credentials
Log in to xSeek. Go to your website's settings and copy:
- API Key — starts with
aist_... - Website ID — a UUID like
a1b2c3d4-...
Step 2 — Open your domain in Edgely
In the Edgely dashboard, click on the domain you want to track. Scroll down to the xSeek AI Analytics section.
Step 3 — Paste your credentials and connect
Enter your API key and website ID in the form and click Connect xSeek. That's it — no code changes, no script embed, no server restarts.
Step 4 — Verify tracking is live
You can test immediately by simulating an AI bot request:
curl -A "GPTBot/1.0" https://www.yourdomain.com/Within seconds the visit should appear in your xSeek dashboard under AI Bot Visits.
Which AI Bots Does Edgely Detect?
Edgely's bot detection covers all major AI crawlers that identify themselves via their User-Agent string: [4]
| Bot Name | Company |
|---|---|
| GPTBot | OpenAI |
| ChatGPT-User | OpenAI |
| ClaudeBot | Anthropic |
| Claude-User | Anthropic |
| PerplexityBot | Perplexity AI |
| Gemini | |
| Googlebot | |
| Bingbot | Microsoft |
| CCBot | Common Crawl |
| Bytespider | ByteDance |
| YouBot | You.com |
| DuckAssistBot | DuckDuckGo |
| Meta-ExternalAgent | Meta |
| Amazonbot | Amazon |
| Applebot | Apple |
Works on Any Platform — No Code Changes Required
Because tracking happens at the proxy layer, xSeek + Edgely works with every platform Edgely supports:
- Lovable, Framer, Webflow, Wix, Squarespace
- Vercel, Netlify, Ghost
- Any custom web app served behind the Edgely proxy
You don't need access to the platform's codebase, server configuration, or build process. If your domain is routed through Edgely, xSeek tracking is one form-fill away.
Zero Latency Impact
The xSeek tracking call is completely fire-and-forget. Edgely sends the event asynchronously after the response is already streaming to the client — so the tracking never sits in the critical path of your page load. [5]
What You Can Do with xSeek Data
- Identify which pages AI agents read most — prioritise those for GEO optimisation.
- Track which AI bots visit over time — understand if your content is being indexed for training or for search.
- Correlate AI visits with brand mentions — measure whether AI crawling leads to AI-generated citations in Perplexity, ChatGPT Search, or Claude.
- Monitor new bot types — xSeek updates its detection as new AI crawlers launch.
Edgely routes your custom domain through its edge proxy — add your xSeek credentials in the dashboard and every AI bot visit is automatically captured without touching your site's code.
Key Takeaways
- AI bots like GPTBot, ClaudeBot, and PerplexityBot don't execute JavaScript — traditional analytics miss them entirely.
- Edgely detects AI bots at the proxy layer and forwards visit data to xSeek automatically.
- Setup takes two minutes: paste your xSeek API key and website ID into the Edgely domain settings.
- Works on any platform (Lovable, Framer, Webflow, Vercel, etc.) without touching your code.
- Tracking is zero-latency — events fire asynchronously after the response has already been sent.
Frequently Asked Questions
Do I need to add a script to my website to track AI bots?
No. Edgely tracks AI bots at the proxy layer by inspecting the User-Agent header of every incoming request. No script embed, no code changes, and no access to your platform's codebase is required.
Which AI bots does Edgely detect?
Edgely detects 15+ known AI crawlers including GPTBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, Gemini, CCBot, Bytespider, YouBot, DuckAssistBot, Meta-ExternalAgent, Amazonbot, and Applebot.
Does xSeek tracking add latency to my website?
No. The xSeek tracking call is fire-and-forget and runs asynchronously after the response has already started streaming to the client. It never sits in the critical path of your page load.
Can I connect xSeek to multiple domains?
Yes. You can connect xSeek to each domain individually in the Edgely dashboard. Each domain can have its own xSeek website ID, so visits are tracked separately per property.
Does this work if my website is built on Lovable, Framer, Webflow, or another platform?
Yes. The tracking happens at the Edgely proxy layer, not inside your website. It works with any platform whose traffic is routed through Edgely — Lovable, Framer, Webflow, Vercel, Netlify, Ghost, and any custom app.
What is Generative Engine Optimisation (GEO)?
GEO is the practice of optimising your website so it appears in AI-generated answers from tools like ChatGPT Search, Perplexity, and Claude. Knowing which AI bots visit your site — via xSeek — is the first step to understanding and improving your GEO performance.
Sources & Citations
- [1]GPTBot User Agent Documentation (OpenAI)— openai.com
- [2]Generative Engine Optimisation — Research Paper— arxiv.org
- [3]Vercel Edge Middleware Documentation— vercel.com
- [4]ClaudeBot User Agent (Anthropic)— anthropic.com
- [5]Fetch API — Fire and Forget Pattern— developer.mozilla.org
Ready to add your custom domain?
Set up your reverse proxy in under 5 minutes — free, with SSL and edge caching included.