ScrapingBee logo

The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.

Don't know where to begin?

Check out our most popular articles.

Web scraping without getting blocked Web scraping without getting blocked Web scraping in Python Web scraping in Python Web scraping in NodeJS Web scraping in NodeJS Web scraping in R Web scraping in R Web scraping in C++ Web scraping in C++ Web scraping in C# Web scraping in C# Web scraping in Php Web scraping in Php Web scraping in Scala Web scraping in Scala Java web scraping Book Java web scraping Book Web scraping in Ruby Web scraping in Ruby Web scraping in Go Web scraping in Go Web scraping in Elixir Web scraping in Elixir Web scraping in Rust Web scraping in Rust Web scraping in Perl Web scraping in Perl No code web scraping No code web scraping No code competitor monitoring No code competitor monitoring
N8N No-Code Web Scraping Made Simple with AI-Powered Data Extraction
10 min read

N8N No-Code Web Scraping Made Simple with AI-Powered Data Extraction

Learn N8N web scraping with our step-by-step tutorial. Build AI-powered data collection workflows in minutes. No coding required - just visual automation.

Ismail Ajagbe
29 min read

Web Scraping with JavaScript and Node.js

Learn web scraping with JavaScript and Node.js with this step-by-step tutorial. We will see the different ways to scrape the web in JavaScript through lots of examples.

Kevin Sahin
5 min read

How to use a proxy with node-fetch?

In this tutorial we will see how to use a proxy with the node-fetch package. We will also discuss on how to choose the right proxy provider.

Grzegorz Piwowarek
7 min read

Puppeteer Web Scraping Tutorial in Nodejs

This tutorial explores how to scrape Reddit using a headless Chrome instance in Node.js with the Puppeteer library.

Alexander M
2 min read

ScrapingBee is joining Oxylabs’ group

We’re incredibly proud and excited to announce that ScrapingBee has officially become part of Oxylabs’ group

Kevin Sahin
11 min read

The Best JavaScript Web Scraping Libraries

Discover the best JavaScript web scraping libraries for 2025. We compare Playwright, Puppeteer, Cheerio, and more with code examples, pros, and cons to help you choose the right tool.

Ilya Krukowski
7 min read

urllib3 vs. Requests: Which HTTP Client is Best for Python?

We compare urllib3 vs. Requests to show you which is best suited for different scenarios.

Karthik Devan
40 min read

Python Web Scraping: Full Tutorial With Examples (2025)

Learn about web scraping in Python with this step-by-step tutorial. We will cover almost all of the tools Python offers to scrape the web. From Requests to BeautifulSoup, Scrapy, Selenium and more.

Kevin Sahin
19 min read

Python HTML Parsers

Web scraping comes in handy when collecting large amounts of data from the internet. This roundup shares a list of popular Python HTML parsers you can use to simplify web scraping.

Karthik Devan
11 min read

What is Screen Scraping and How To Do It With Examples

Unlock data from any source! Learn Python screen scraping for web, GUIs, and terminals. Practical examples, tools, and tips to get you started.

Grzegorz Piwowarek
56 min read

Web Scraping with R Tutorial: Scraping BrickEconomy.com

In-depth R web scraping tutorial. Master data extraction with rvest, httr2, & chromote. Handle JavaScript, pagination, avoid blocks & analyze results. Code included.

Ismail Ajagbe
32 min read

ChatGPT Scraping - How to Vibe Scrape with ChatGPT

Can ChatGPT scrape the web for product data? We tested it on Apple’s refurbished store and documented the journey from vibe coding to real scraping.

Karthik Devan
20 min read

How to bypass PerimeterX anti-bot system in 2025

Learn how to bypass PerimeterX/HUMAN anti-bot system with working examples that you can use straight away to scrape the data you need.

Ilya Krukowski
11 min read

Playwright MCP - Scraping Smithery MCP database Tutorial with Cursor

Discover how AI, using Model Context Protocol (MCP), can scrape web data without code, showcasing the Playwright MCP's potential and limitations in web scraping.

Karthik Devan
28 min read

The Best Web Scraping Tools & Software in 2025

Web scraping tools & software are used to extract data from the internet. Here is our list of the best web scraping tools for 2025.

Kevin Sahin
Next