CodeBot
CodeBot is the website crawler of CODE (usecode.ai), an SEO and content platform. CODE customers use it to run technical SEO audits of websites they choose.
How to recognise it
Every CodeBot request sends this user agent:
CodeBot/1.0 (+https://usecode.ai/bot)Requests are also signed with Web Bot Auth (HTTP Message Signatures). They carry the header Signature-Agent: "https://usecode.ai", and our public keys are published at https://usecode.ai/.well-known/http-message-signatures-directory. A request that uses our user agent without a valid signature is not from us.
What it does
- It fetches pages to check status codes, redirects, titles, headings, links, and structured data.
- It loads pages in a headless browser, so it sees the page as a visitor does. It does not download images, fonts, or media.
- It only crawls the sites and pages a CODE customer asked to audit.
- It does not log in, submit forms, solve CAPTCHAs, or hide its identity.
How it treats your site
- It obeys
robots.txt. - It obeys
Crawl-delay. Without one, it sends no more than 2 requests per second to a site.
What happens to the data
We store the audit results with their source URLs, for the customer who ran the audit. We do not sell crawled content, republish it, or use it to train AI models.
How to block or limit it
To block CodeBot from your whole site, add this to your robots.txt:
User-agent: CodeBot
Disallow: /To slow it down, add a Crawl-delay in seconds under the same User-agent line.
Contact
For questions, problems, or requests to stop crawling, email stales@ecommsage.com. Please include your domain and, if you have them, the times of the requests or the Cloudflare Ray IDs.