While this is a small release, it’s one that many customers have been asking for.

We’ve added a unique identifier to all requests made by our Knowledge Base scraper. This means if your web content is protected by security layers (e.g. Cloudflare, AWS WAF), you can now whitelist the X-Talkative-Auth header to allow the scraper to access the website uninhibited.

This was a common ask from customers using protected sites for their knowledge base, and should make KB syncing more reliable in those scenarios.

There is not setup required - all that you'd need to do is to whitelist 'x-talkative-auth' header which is now always present in the request.

Let us know if you’d like help with anything.

Talkative changelog

Improved KB scraping reliability with custom headers