The Karla Bot is a specialized, benign web crawler operated by Karla ApS. We provide a suite of intelligent AI-driven solutions for businesses, including:
When a client integrates our services via our official API script (delivered via static.getkarla.ai), our crawler fetches the client's sitemap.xml and reads their public web pages.
The purpose of this crawling is to index the client's content to enable Retrieval-Augmented Generation (RAG). This ensures that our AI services (Chat, Search, and Inbox) only provide answers and guidance based on the client’s own official, up-to-date information.
Karla ApS is committed to the highest standards of data protection:
No AI Training: Data processed by our crawler is used exclusively for the client's functional use and is not used to train or further develop underlying AI model.
Security Standards: Our operations are managed with reference to ISO 27001/2 (IT Security) and ISO 27701 (Privacy Information Management).
Authorization: We only crawl websites where we have an active service agreement and explicit authorization from the domain owner.
You can identify our crawler in your server logs by the following details:
Our crawler strictly respects robots.txt directives. Note that blocking the bot will prevent Karla Chat, Search, and Inbox from automatically updating their knowledge base from your website.
To block the bot from specific directories:
User-agent: KarlaBot
Disallow: /
If you have questions regarding our crawler, or if you need to whitelist our IP addresses in your firewall (e.g., Cloudflare WAF), please contact our support team: