The Web Scraping Club

The Web Scraping Club

Home
News
The Lab
Advertise on TWSC
Proxy pricing benchmark
Consulting
Archive
About

September 2026

What breaks in a long-running authenticated scraper session, and how to keep it logged in
Most scrapers work fine for a few hours, but not if you keep one logged in for a few weeks.
 • Joel Griffith
How to Use Scraping to Analyze Social Media Trends
A deep dive int how to build a multi-platform social media scraping pipeline that turns posts, hashtags, and engagement data into meaningful trend…
 • Federico Trotta
The LAB #116: Warming an Imperva reese84 cookie, and replaying it without a browser
A tenth of a cent buys thirteen minutes of scraping, from any IP I tried
 • Pierluigi Vinciguerra
Build or buy, now that writing code is almost free
How the break-even between building and buying moved now that agents write the code
 • Pierluigi Vinciguerra
Testing webclaw: A Firecrawl Alternative for Web Extraction in AI Agents
A hands-on look at webclaw’s CLI and APIs
 • Antonello Zanini
Deterministic Data: The Case for Web Scraping Over LLM Web Search Tools
Understanding the non-deterministic nature of AI web access, and why web scraping is the best retrieval layer
 • Federico Trotta
The LAB #115: Manus at Work - Datadome on Leboncoin.fr
What DataDome's tag really sends and collects, read line by line on leboncoin.fr.
 • Pierluigi Vinciguerra
Crawl of Fame - September 2026
Never a boring month in the web scraping industry
 • Pierluigi Vinciguerra
The Impact of Chrome's New CPU Performance API on Web Scraping Detection
Anti-bot solutions just got a new tool in their hardware fingerprinting toolbox
 • Antonello Zanini
AntsData Review: A Deep Dive into its SERP and Web Search APIs
A technical walkthrough on integrating the AntsData services into your web scraping workflow.
 • Federico Trotta

August 2026

© 2026 The Web Scraping Club SRL · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture