Apify blog shows how task examples can boost Actor traffic and search visibility
A blog post on Apify describes how adding task examples to an Actor doubled organic traffic and increased search impressions tenfold in a month.
A blog post on Apify describes how adding task examples to an Actor doubled organic traffic and increased search impressions tenfold in a month.
Apify published a tutorial showing how to crawl a website, sync changed pages into Qdrant via n8n, and re-embed only the diffs, with measured run times and cost figures.
Apify released a guide showing how to combine its web scraping platform with LangChain, OpenAI, and Pinecone to create an AI-powered documentation chatbot.
Browserless published a blog post comparing the three major browser automation frameworks.
Browserless has announced a new protocol for browser automation.
Browserless has released a plugin for the Cursor AI code editor that integrates its headless browser service directly into the development workflow.
A developer released Draco, an open-source, single-binary web scraping tool in Rust designed as a self-hostable alternative to paid APIs like Firecrawl and Browserbase.
Firecrawl announced a new Convex component that allows developers to integrate web scraping capabilities directly into their Convex applications.
Google published a blog post on its bug hunters portal describing how it uses AI to assist in rewriting C and C++ dependencies into Rust at scale.
A small indie studio with demoscene roots has built a RISC-V emulator into their upcoming space terraforming game SEEDS, allowing players to run Linux inside the game.
The Jactl scripting language introduces virtual thread support for Java 8, bypassing the need for Project Loom.
A new tool called LuaCAD lets users model solids in Lua instead of the OpenSCAD language, offering a CLI and desktop app with preview and editor.
Lunatik 5.0, a framework for scripting the Linux kernel with Lua, now integrates with eBPF.
Magic.dev has shared a blog post detailing techniques for compute-efficient pretraining and scaling to trillion-parameter models.
A developer released Mini-AGI, a dynamic continual learning model that runs on 8GB VRAM, on GitHub as a Show HN post.
A new open-source browser extension called PageSieve enables users to scrape data from websites directly within Firefox.
Playwright 1.63.0 introduces named test locks that prevent concurrent execution of tests sharing the same lock name across files, workers, and projects.
Microsoft released Playwright v1.64.1, a patch fixing two bugs: an intermittent loss of a packaged Electron app's first window and a Chromium 155+ regression that aborts preflighted cross-origin redirects when any route is registered.
Puppeteer released version 25.10.0 of puppeteer-core, introducing a video-stream-based screen recording feature via page.record() and rolling to Firefox 155.0.
Puppeteer released v3.2.5 of its browsers package, fixing a symlink chain escape during zip extraction and a path traversal issue from buildId, along with a fix for alias removal on uninstall.
Puppeteer released version 25.13.0 of puppeteer-core with new features including page, frame, and worker methods on ConsoleMessage, configurable WebSocket max payload, and asFetchRequest/asFetchResponse methods on HTTPRequest and HTTPResponse.
Puppeteer released version 25.14.0 of puppeteer-core, migrating network emulation to a new rule-based API and rolling to Firefox 158.0.
Puppeteer released version 25.15.0 of puppeteer-core with several new features and fixes.
Puppeteer released version 25.16.0 of puppeteer-core with support for unmodified post data via HTTPRequest.content(), base64 decoding, a roll to Chrome 156.0.8078.47, and a fix for page ranges without spaces in Page.pdf().
Puppeteer released version 25.8.0 of puppeteer-core with a new followSymlinks option, a validatePath fix for computeSystemExecutablePath, and a change to launch browsers in detached mode on Windows to reduce flakiness.
Puppeteer released version 25.9.0 of puppeteer-core, updating browser versions and adding support for shadow roots in MutationPoller and tool execution cancellation in webmcp.
A new open-source Python library, PyScrappy, offers self-healing CSS/XPath selectors and an MCP server for resilient web scraping.
SerpApi's blog covers the release of RubyLLM 2.0 and 2.1, which introduce incremental agent loop execution, human approval for tools, and database-backed agent persistence.
Scrapfly published a workflow-based comparison of seven C# web scraping libraries, covering HTML parsing with Html Agility Pack and AngleSharp, browser automation with Playwright for .NET, Selenium, and PuppeteerSharp, and crawl orchestration with Abot and DotnetSpider.
Scrapfly published a blog post evaluating eight Python HTTP clients on async support, HTTP/2, HTTP/3, TLS impersonation, and maintenance, with runnable examples.
Scrapfly published a comparison of nine Go web scraping libraries and APIs, evaluating each by its best use case, current release, and license.
Scrapfly published a blog post comparing Browser Use and Playwright, covering architectural differences, speed and cost tradeoffs, silent failure risks, and a hybrid approach for production scraping.
Scrapfly published a blog post evaluating five open-source Amazon scraper repositories by stars, commit recency, license, code paths, and live failure modes.
A blog post from Scrapfly evaluates HTTPie, aria2, and other tools that address specific limitations of cURL and Wget, including a managed fetch tool for blocked requests.
Scrapfly released a blog post cataloging Scrapy error messages with diagnostic checks and version-specific fixes.
Scrapfly released a blog post detailing methods for building parser tests, HTML fixtures, live checks, and deployment gates to catch silent scraper failures early.
Scrapfly released a blog post comparing seven alternatives to Puppeteer for web scraping, covering library rewrites, crawl frameworks, no-browser approaches, and remote stealth browsers.
Scrapfly published a blog post evaluating five open-source LinkedIn scraping repositories on GitHub, ranking them by authentication approach, maintenance status, and real-world blocking risk as of August 2026.
A blog post from Scrapfly filters the crowded open-source proxy tool landscape down to four actively maintained scrapers and checkers worth using this year.
Scrapfly published a blog post comparing six open-source YouTube scrapers, including a GitHub snapshot from August 11, 2026, and noting two projects that failed in their tests.
Scrapfly published a guide ranking eight JavaScript and Node.js libraries for web scraping, covering HTTP clients, parsers, headless browsers, and the Crawlee framework.
Scrapfly tested nine Scrapy extensions and middlewares against Scrapy 2.18, covering rendering, TLS fingerprints, proxies, extraction, shared queues, and deployment.
Scrapfly published a blog post listing the five best open-source Facebook Marketplace scrapers on GitHub as of 2026, along with repos to avoid.
A blog post from Scrapfly rounds up six Rust-based tools for managed page access, static HTML parsing, article extraction, and browser control.
A blog post on ScrapingBee introduces Ruflo, an open-source meta-harness that coordinates swarms of AI agents by wrapping around Claude Code or Codex.
ScrapingBee's blog post covers setting up CloudProxy, its limits, and its managed API for lightweight scraping tasks.
A new tutorial from ScrapingBee walks through distributing Playwright browser tests across Kubernetes pods using the --shard flag and a Testkube agent.
ScrapingBee released a guide covering installation and usage of the community-maintained playwright-ruby-client gem for web scraping and testing in Ruby.
Scrapy 2.18.0 replaces the Twisted-based HTTP/2 handler with httpx2, makes brotli and Zstandard compression always available, and changes late crawler attribute access to raise RuntimeError.
Scrapy released version 2.19.0, introducing a RemoteControl extension for HTTP-based crawl inspection and control, alongside an experimental aiohttp download handler now set as the default for reactor-less runs.
SerpApi released Review Audit, an open-source tool that analyzes a Google Maps place's recent reviews and reviewer histories to estimate how much of its rating is attributable to its own reviewers.
A developer has revived the abandoned spotify-tui project as Spotatui, a terminal-based Spotify client that bypasses web API rate limits.
Stagehand separates Browse release management from the Stagehand SDK release group, introducing an independent publishing job for Browse.
Stagehand released a pre-release version that exposes browser-side predicate waiting consistently across its SDKs, eliminating transport polling.
Stagehand released version 4.2.0a0.dev1543 of its Python SDK, adding PDF rendering support through existing SDK conventions.
A dev release of Stagehand Python introduces a facade tool surface that allows evals to benchmark the exact byte-identical interface shipped to Claude Code, Codex, and Pi integrations.
Stagehand released a dev build that reimplements Browse V3 network capture for the Python SDK using a CLI-private CDP sidecar, avoiding changes to the core protocol or public SDKs.
Stagehand released a dev build that introduces CLI commands to manage project and function secrets for Browse Cloud.
A development release of Stagehand Python fixes waitForSelector to properly account for frame resolution and locator readiness within its timeout.
Stagehand Python 4.2.0a0.dev1524 introduces event hooks that fire when WebMCP tools are added or removed from a page.
Stagehand Python version 4.2.0a0.dev1556 exposes a configurable timeout parameter across all 17 terminal locator methods, with a default of 20 seconds.
Stagehand Python v4.2.0a0.dev1530 flips server-side caching from opt-in back to on-by-default, matching v3 behavior after an upgrade gap silently dropped caching for users who did not opt in.
Stagehand Python v4.2.0a0.dev1576 refactors act(), extract(), and observe() to use a unified progress tracker instead of per-method timeout tracking.
Stagehand published version 0.11.0 of its Browse CLI, decoupling it from the Stagehand SDKs and adding a function to attach existing project secrets by ID.
Stagehand published browse@0.11.1, decoupling the CLI from the SDK and adding a functions init command that scaffolds a Stagehand project using @browserbasehq/stagehand instead of playwright-core.
Stagehand published version 0.10.0 of its Browse CLI, migrating the runtime to Stagehand V4 and removing the --return-xpath option from coordinate actions.
Stagehand published Browse CLI version 0.10.0, decoupling it from the Stagehand SDKs and migrating its runtime to Stagehand V4.
Tilion (YC F26) released version 3 of Fortress, its stealth Chromium-based browser infrastructure, as a free open-source tool for developers.
SerpApi covers the release of Vessel 0.3, a Ruby crawling framework that adds pluggable drivers, a fields API, middleware pipeline, proxy rotation, cookies, retries, and callbacks.
Zyte published a blog post demonstrating how a single Scrapy spider can run unchanged across three browser backends: stock Playwright, Patchright via a new hook, and Zyte's remote CDP browser.
Zyte published a technical walkthrough of Scrapy 2.19's RemoteControl extension, which runs an authenticated HTTP server inside each crawl for live inspection and control.
Zyte published the first part of a new blog series aimed at experienced developers building production-ready Scrapy projects.
Zyte released a practical cheatsheet documenting the default changes in uv 0.12, including project structure, hash checking, and lockfile behavior.
Zyte has open-sourced a command-line tool that performs static analysis on Scrapy projects before a crawl begins, scoring production-readiness and linking findings to fixes.