Scrapy 2.19.0 ships RemoteControl extension and experimental aiohttp download handler
Scrapy released version 2.19.0, introducing a RemoteControl extension for HTTP-based crawl inspection and control, alongside an experimental aiohttp download handler now set as the default for reactor-less runs.
Briefing
- Scrapy: Scrapy released version 2.19.0, introducing a RemoteControl extension for HTTP-based crawl inspection and control, alongside an experimental aiohttp download handler now set as the default for reactor-less runs.
Why it matters
The RemoteControl extension opens the door to tighter integration with external tools like the Scrapy MCP server, enabling real-time monitoring and manipulation of crawls without custom middleware. The shift to an aiohttp-based download handler signals a move toward async-first performance, which could simplify deployment and improve throughput for many users. Both features are experimental but point to Scrapy's evolving architecture.
Sources
- Primary source · Scrapy · 2026-09-10 — scrapy/scrapy 2.19.0
Watch next
Will the RemoteControl extension become a stable API for third-party crawler management tools?