Web Scraping

The Impact of Chrome's New CPU Performance API on Web Scraping Detection

Anti-bot solutions just got a new tool in their hardware fingerprinting toolbox

Sep 6 • Antonello Zanini

AntsData Review: A Deep Dive into its SERP and Web Search APIs

A technical walkthrough on integrating the AntsData services into your web scraping workflow.

Sep 1 • Federico Trotta

Google removed the URLs. Only for the people who resell them.

The goto wrapper is not a rollout. It is what Google sends the clients it has already classified.

Aug 30 • Pierluigi Vinciguerra

The LAB #114: Manus at Work - Kasada on Nike.com

Using Manus AI to study the Kasada anti-bot protection

Aug 26 • Pierluigi Vinciguerra

Scraping Hermès Without a Browser: Hitting the JSON API Behind DataDome

We scraped the entire US Hermès catalog straight off its JSON API, behind DataDome, with zero browsers: 7,690 products at 37 KB each, for a few euros.

Aug 25 • Patrick van den Bosch

Four years of The Web Scraping Club

On August 2022 The Web Scraping Club born. 4 years later the industry looks another world.

Aug 16 • Pierluigi Vinciguerra

Prepare Web Content and Documents for LLM Ingestion Using MarkItDown

Markdown is the language of AI. Learn how to convert different data formats into it!

Aug 9 • Antonello Zanini

Tool of the week #1: Bright Data Scraper Studio, From Prompt to Production Scraper in Minutes

Explore how Bright Data's Scraper Studio bridges the gap between AI-assisted building and full IDE-level control without locking you into either.

Aug 4 • Federico Trotta

Why Your RAG Pipelines Are Only as Good as Your Data Acquisition Layer

A deep dive into what RAG actually requires, where web search integration falls short, and why scraping is the only retrieval layer that scales.

Aug 2 • Federico Trotta

Crawl of Fame - July 2026

The rollercoaster of the proxy industry and a a sigh of relief for the industry

Jul 27 • Pierluigi Vinciguerra

Hands-On Guide to SearchApi's Web Search MCP Server

Enable AI agents to access data from major search engines via MCP with SearchApi!

Jul 26 • Antonello Zanini

THE LAB #111: The OSS browser automation stealth benchmark

Fifteen tools against two live bot detectors, and only four passed the strict one.

Jul 23 • Pierluigi Vinciguerra

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts