Cloudflare has rolled out a new system designed to continuously evaluate the behavior of its Verified Bots. This initiative moves beyond initial identity verification to focus on ongoing trustworthiness, addressing the question of whether a bot can be trusted based on its actions over time. The system aims to ensure that Verified Bots consistently adhere to expected standards of conduct.
The new system distinguishes between 'risk' and 'trust'. Risk refers to the likelihood of a single request or action being harmful, which can change moment-to-moment. Trust, conversely, is built through repeated and consistent behavior over time. For a bot to remain Verified, it must accurately identify itself, perform only its stated functions, and refrain from abusive behavior.
A core component of the system is monitoring for abusive behavior, particularly regarding respect for site preferences. This includes whether crawlers ignore requests to not crawl or to slow down. Cloudflare developed metrics to measure how often a bot respects these preferences, translating observations into an 'explainable trust band' that indicates consistency and informs assessment.
Initial signals evaluated by the system include whether the bot respects instructions and if it responds to direct feedback from websites. These are considered fundamental 'common sense' rules for bot etiquette. An example cited is the delisting of Perplexity's bot in 2025 for attempting to access opted-out resources and circumventing controls.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's briefNew every morning, and the back catalogue is archived by date.
Cloudflare launched a new system to continuously evaluate and report on the behavior of Verified Bots. This system assesses whether bots adhere to stated intentions and avoid abusive actions, ensuring ongoing trustworthiness beyond initial identity verification. It aims to maintain trust by monitoring compliance with website preferences and direct feedback.