The Web Scraping Club | Pierluigi Vinciguerra | Substack

THE LAB #113: Obscura browser against Akamai

A 30MB browser and a Radisson deal finder during Oktoberfest

READ THE LATEST

Most Popular

THE LAB #1: Scraping data from an app

Sep 4, 2022 • Pierluigi Vinciguerra

THE LAB #3: Scraping Cloudflare protected websites

Sep 27, 2022 • Pierluigi Vinciguerra

THE LAB #73: How to Bypass Cloudflare in 2025

Jan 23, 2025 • Pierluigi Vinciguerra

Ten years of web scraping: a personal perspective about selling web data

Mar 24, 2024 • Pierluigi Vinciguerra

Platinum Partner

The Great Web Unblocker Benchmark - Cloudflare Edition

Testing different web unblockers against Indeed.com

Sep 22, 2024 • Pierluigi Vinciguerra

The Web Unblocker Cost Benchmark

Price comparison between the most well-known web unblockers on the market

Dec 24, 2023 • Pierluigi Vinciguerra

Recent posts

Four years of The Web Scraping Club

On August 2022 The Web Scraping Club born. 4 years later the industry looks another world.

Aug 16 • Pierluigi Vinciguerra

Prepare Web Content and Documents for LLM Ingestion Using MarkItDown

Markdown is the language of AI. Learn how to convert different data formats into it!

Aug 9 • Antonello Zanini

Tool of the week #1: Bright Data Scraper Studio, From Prompt to Production Scraper in Minutes

Explore how Bright Data's Scraper Studio bridges the gap between AI-assisted building and full IDE-level control without locking you into either.

Aug 4 • Federico Trotta

AI

Why Your RAG Pipelines Are Only as Good as Your Data Acquisition Layer

A deep dive into what RAG actually requires, where web search integration falls short, and why scraping is the only retrieval layer that scales.

Aug 2 • Federico Trotta

Build an AI Agent for Scraping and Analyzing Research Papers

Let’s build an AI agent in Python for research paper scraping and analysis.

Dec 14, 2025 • Antonello Zanini

Using NLP for Entity Extraction From Scraped Data

From theory to practice: how to extract entities from textual scraped data using NLP

Dec 7, 2025 • Federico Trotta

Using AI to Detect Patterns in Scraped Data

A practical guide on finding patterns in scraped data with advanced techniques

Nov 23, 2025 • Federico Trotta

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts