ScrapingBee examines how anti-bot vendors like Cloudflare, DataDome, Akamai, and HUMAN are classifying and blocking browsers operated by language models, such as Perplexity's Comet, ChatGPT browsing, Claude computer use, and Playwright MCP agents.
Bright Data's blog has published a how-to guide detailing methods to circumvent Kasada's anti-bot system.
Browserless published a blog post discussing the use of OS emulation techniques in web scraping.
Browserless has published a blog post detailing a method to bypass Cloudflare's Turnstile challenge.
Browserless released a blog post detailing techniques to circumvent Akamai's bot detection systems.
Browserless released a blog post detailing techniques to circumvent Datadome's anti-bot system.
Browserless released a blog post detailing methods to bypass Kasada, a JavaScript-based anti-bot system.
Browserless released a blog post detailing methods to circumvent PerimeterX's anti-bot system.
Zyte reports that CAPTCHA has quietly transformed into an invisible behavioral scoring system, with two vendors powering 89% of implementations and the smallest sites deploying it most heavily.
A data leak affecting 7.3 million Chess.com users has been reported, with initial evidence suggesting the data was obtained through web scraping.
Zyte reports that Chrome 152 will expose a navigator.cpuPerformance property, giving sites a new way to fingerprint browsers.
Cloudflare reports that during strikes on Yandex data centers, malicious bots did not go offline but instead moved to other networks.
Cloudflare introduced a new dashboard that uses stateful analysis and edge-generated Hashed User IDs to help teams investigate and block account abuse, countering AI-driven fraud.
Cloudflare introduces Adaptive Intelligence, a new engine that autonomously learns from live traffic meta-signals to counter bot operators' economic advantages.
Cloudflare introduces Bot Preference Sync, a feature that automatically synchronizes a site's robots.txt file with its AI bot management policies for search, agent, and training bots.
Cloudflare has introduced a new dashboard interface for bot operators to manage their submissions to the company's bot directory, including status tracking, editing, and a behavior model for declaring content usage.
Cloudflare has introduced a dedicated dashboard section where bot operators can submit, track, and edit their bot declarations, including a behavior model for content usage.
Cloudflare announces that more than half of traffic to sites on its network is automated, and it is providing site owners with tools to identify, manage, and monetize AI agent access.
Cloudflare announced a new approach to bot mitigation that moves from point-in-time risk assessment to continuous trust evaluation, introducing systems BotBase and Precursor to assess good and bad behaviors from bots and agents.
Cloudflare introduces Turnstile Spin, a feature that leverages AI coding agents to configure server-side verification for Turnstile, preventing misconfigurations that leave sites vulnerable to bots.
Crawlbase published a blog post explaining the throughput math, Go-based control plane, and scaling challenges required to solve 8,000 CAPTCHAs per second.
Crawlbase ships Web Bot Auth, a specification that treats bot identity as a verifiable signature rather than a self-declared claim, on the same day it launches pay-per-crawl pricing.
Crawlbase released a blog post covering changes from Cloudflare, DataDome, and Akamai in 2026, along with guidance on distinguishing blocks from parser failures and evaluating fixes by cost per usable result.
Crawlbase's blog post outlines a method to identify Cloudflare Turnstile challenges hidden behind 200 OK responses by inspecting the response body and classifying them as ok, challenge, or hard_block.
DataDome published a case study showing how a high-traffic platform recovered 8% revenue in 24 hours after switching from signature-based detection to behavioral analysis.
DataDome publishes a post arguing that CDN-level bot management cannot handle modern AI agents and that enterprises should layer a specialist bot and agent trust solution on top.
DataDome publishes a post arguing that Web Bot Auth and Know Your Agent methods verify identity but fail to assess real-time agent behavior.
DataDome published a customer story showing how tire retailer 1001Pneus used its anti-bot platform to stop competitor price scrapers hiding behind residential IP addresses.
DataDome's CEO and Forrester analysts discuss the findings of The Forrester Wave: Bot and Agent Trust Management Software, Q2 2026.
DataDome introduced AI Key Takeaways, a feature that generates real-time summaries of security data with separate views for analysts and executives.
DataDome introduced a hosted MCP server that allows AI agents to query its Trend Reports data using natural language.
DataDome has been recognized as a Sample Vendor in the AI Agent Bot Management category of the Gartner Hype Cycle for Application Security, 2026.
DataDome released a blog post explaining how AI agents require dedicated identities, scoped permissions, and real-time oversight beyond traditional identity and access management.
DataDome released a guide covering methods to block AI bots, from robots.txt to advanced bot management.
DataDome's Q3 2026 AI Traffic Report documents a 4.7x jump in agentic browser traffic in September, with Meta's Muse alone making 29 million requests in its first 12 days.
DataDome published a report documenting 7.9 billion AI agent requests in early 2026, highlighting spoofing and detection blind spots.
DataDome's latest report reveals a 41.5% surge in AI agent traffic and a 4.7x increase in agentic browser requests, with Meta's Muse arriving unannounced from the cloud.
DataDome's 2026 State of Bot & Agent Security Report finds that AI agent traffic has increased 82% and is increasingly targeting login, cart, and payment flows with spoofed identities.
DataDome published a report detailing 7.9 billion AI agent requests recorded in early 2026, highlighting spoofing and visibility gaps that leave retail systems exposed.
DataDome published a report documenting 7.9 billion AI agent requests in early 2026, highlighting spoofing and visibility gaps that leave organizations exposed.
DataDome recorded 7.9 billion AI agent requests in early 2026 and published a report revealing widespread spoofing and visibility gaps that leave organizations exposed.
DataDome published a report recording 7.9 billion AI agent requests in early 2026, revealing widespread spoofing and visibility gaps that leave organizations exposed.
DataDome recorded 7.9 billion AI agent requests in early 2026 and published a report highlighting widespread spoofing and visibility gaps in bot detection.
DataDome released its 2026 State of Bot & Agent Security Report, revealing that malicious automated traffic is expanding at nine times the rate of human traffic.
DataDome published a report showing bad bot traffic is accelerating at 9 times the rate of human web traffic, logging 7.9 billion AI agent requests and highlighting widespread spoofing and visibility gaps.
DataDome recorded 7.9 billion AI agent requests in early 2026 and reports widespread spoofing and visibility gaps leaving organizations exposed.
DataDome's State of Bot & Agent Security Report 2026 reveals that malicious automated traffic grew 9x in 12 months and is increasingly targeting deeper parts of the customer journey.
DataDome recorded 7.9 billion AI agent requests in early 2026 and published a report showing widespread spoofing and visibility gaps leave most organizations exposed.
DataDome tested 21,491 popular websites against bots and spoofed AI agents to identify which industries are least protected.
DataDome announced that its Agent Trust product has been recognized by Fast Company's Next Big Things in Tech list for its approach to controlling AI agents by assessing intent rather than identity.
DataDome has released updates to its Account Protect product, adding deeper visibility, broader detection across password-reset flows, and API control over protection status.
DataDome publishes an analysis of Meta's Muse agentic browsing tool, highlighting that it does not self-identify and can bypass fingerprinting-based defenses.
Google has deployed a new URL structure, google.com/goto/, that redirects through an intermediate page, adding friction for scrapers.
A study published on Growtika claims that Google has made web scraping 10 times harder in less than a year through changes to its GOTO link structure.
A blog post on Kameleo's site describes a technique for observing browser fingerprinting calls by instrumenting Chromium's Blink rendering layer.
Scrapfly published a technical guide examining whether Chrome DevTools Protocol is inherently detectable and how tools like WebDriver, Playwright, Puppeteer, nodriver, Camoufox, and cloud browsers differ in detection risk.
Scrapfly released a walkthrough covering nine mechanisms that can block a Scrapy spider, from IP reputation to CAPTCHA, with evidence and mitigation steps for each.
Scrapfly released a blog post detailing how AWS WAF Bot Control detects scrapers across five layers and how to bypass it using their Scrapfly ASP product.
Scrapfly's blog post explains how to distinguish between BIG-IP Bot Defense and F5 Distributed Cloud Bot Defense, inspect their browser telemetry, and configure a browser-backed fetch to evade them.
SerpApi published a guide covering the causes of HTTP 429 errors, how to read Retry-After headers, and strategies for retrying requests without escalating blocking.
A Hacker News user reports that YouTube is enforcing strict session cookie limits that cause logged-out users browsing in incognito mode to be blocked and prompted to log in.
Zenrows published a benchmark testing four web scraping APIs with 800 requests against DataDome, Cloudflare, and Akamai, finding two APIs failed to return any usable pages from the DataDome target.
Zyte published a blog post arguing that rate limiting is an identity check rather than a speed limit, citing data that 93.7% of rate-limited sites block on the very first request.
Zyte published a blog post analyzing the prevalence and significance of dedicated antibot systems on top websites.
Zyte published a large-scale audit of web access controls showing how different industries enforce different policies toward bots.
Zyte publishes a blog post arguing that the rise of AI agents is intensifying the conflict between web scrapers and anti-bot systems, risking the fragmentation of the open web.
Zyte publishes a blog post detailing how TLS fingerprinting works as a stealthy anti-bot barrier that operates before any HTTP request is made.
Zyte released a comprehensive audit of how websites regulate programmatic visits, revealing the current state of web access barriers.
A Zyte blog post examines the anti-bot and blocking measures used by fashion e-commerce sites, finding they are some of the most aggressively protected on the web.
Zyte published a blog post detailing how major retail marketplaces deploy anti-bot technology to block AI crawlers and automated data extraction.
Zyte published a blog post stating that Web Application Firewalls are present on 92.4% of the top websites, but most were bundled with a CDN and never configured to block automated access.