Tencent Cloud EdgeOne has officially released its Basic Bot Management capabilities to all users, including those on the Free Plan. This update introduces two core features - AI Crawler Control and the CAPTCHA Page - designed to help developers manage aggressive AI scraping, protect original content, and reduce unnecessary infrastructure costs caused by unauthorized data harvesting.
As demand for training data for generative AI models continues to surge, developers face increasing challenges from stealthy, large-scale AI crawlers that are difficult to detect and block effectively. Traditional methods often lead to an ongoing "Whac-A-Mole" cycle, where blocking one IP or User-Agent results in new variants appearing rapidly, wasting bandwidth and risking content theft.
AI Crawler Control addresses the stealthy and rapidly evolving nature of modern AI bots by maintaining continuously updated identification rules. Rather than requiring custom scripts or constant manual updates, developers can configure policies directly in the EdgeOne console to apply the desired action based on their business needs:
This granular control enables organizations to balance content protection with participation in the broader AI ecosystem where appropriate.
The CAPTCHA Page feature adds a second layer of defense by detecting suspicious automated behavior and prompting human verification. It operates intelligently to avoid false positives, ensuring real users experience no friction while effectively stopping scripts from inflating metrics, disrupting services, or harvesting data in high-stakes environments.
"With the rapid evolution of AI technology, the governance of content and data access is a long-term challenge," said Yun Li, Head of Tencent Cloud EdgeOne Product Team. "By making our Basic Bot Management capabilities free, we aim to help every developer shift from passive defense to active management, giving them full control over their digital assets."
These capabilities are now available in the EdgeOne console, empowering developers to establish clear boundaries between AI innovation and content rights protection. Tencent Cloud EdgeOne continues to enhance its bot management and security features to support evolving developer needs.
About Tencent Cloud EdgeOne:
EdgeOne is Tencent Cloud's integrated platform for edge security and acceleration.
About Tencent Cloud:
Tencent Cloud, one of the world's leading cloud companies, is committed to creating innovative solutions to resolve real-world issues and enabling digital transformation for smart industries. Through our extensive global infrastructure, Tencent Cloud provides businesses across the globe with stable and secure industry-leading cloud products and services, leveraging technological advancements such as cloud computing, Big Data analytics, AI, IoT, and network security. It is our constant mission to meet the needs of industries across the board, including the fields of gaming, media and entertainment, finance, healthcare, property, retail, travel, and transportation.
TechIntelPro empowers B2B technology decision-makers with the latest industry trends, deep insights, leadership perspectives and actionable intelligence to drive both organizational and professional milestones—and thrive on the tech pulse.