Web Scraping

Build or buy, now that writing code is almost free

How the break-even between building and buying moved now that agents write the code

17 hrs ago • Pierluigi Vinciguerra

Testing webclaw: A Firecrawl Alternative for Web Extraction in AI Agents

A hands-on look at webclaw’s CLI and APIs

Sep 15 • Antonello Zanini

Deterministic Data: The Case for Web Scraping Over LLM Web Search Tools

Understanding the non-deterministic nature of AI web access, and why web scraping is the best retrieval layer

Sep 13 • Federico Trotta

The LAB #115: Manus at Work - Datadome on Leboncoin.fr

What DataDome's tag really sends and collects, read line by line on leboncoin.fr.

Sep 10 • Pierluigi Vinciguerra

Crawl of Fame - September 2026

Never a boring month in the web scraping industry

Sep 8 • Pierluigi Vinciguerra

The Impact of Chrome's New CPU Performance API on Web Scraping Detection

Anti-bot solutions just got a new tool in their hardware fingerprinting toolbox

Sep 6 • Antonello Zanini

AntsData Review: A Deep Dive into its SERP and Web Search APIs

A technical walkthrough on integrating the AntsData services into your web scraping workflow.

Sep 1 • Federico Trotta

Google removed the URLs. Only for the people who resell them.

The goto wrapper is not a rollout. It is what Google sends the clients it has already classified.

Aug 30 • Pierluigi Vinciguerra

The LAB #114: Manus at Work - Kasada on Nike.com

Using Manus AI to study the Kasada anti-bot protection

Aug 26 • Pierluigi Vinciguerra

Scraping Hermès Without a Browser: Hitting the JSON API Behind DataDome

We scraped the entire US Hermès catalog straight off its JSON API, behind DataDome, with zero browsers: 7,690 products at 37 KB each, for a few euros.

Aug 25 • Patrick van den Bosch

Four years of The Web Scraping Club

On August 2022 The Web Scraping Club born. 4 years later the industry looks another world.

Aug 16 • Pierluigi Vinciguerra

Prepare Web Content and Documents for LLM Ingestion Using MarkItDown

Markdown is the language of AI. Learn how to convert different data formats into it!

Aug 9 • Antonello Zanini

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts