ScrapingBee logo

The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.

Don't know where to begin?

Check out our most popular articles.

Web scraping without getting blocked Web scraping without getting blocked Web scraping in Python Web scraping in Python Web scraping in NodeJS Web scraping in NodeJS Web scraping in R Web scraping in R Web scraping in C++ Web scraping in C++ Web scraping in C# Web scraping in C# Web scraping in Php Web scraping in Php Web scraping in Scala Web scraping in Scala Java web scraping Book Java web scraping Book Web scraping in Ruby Web scraping in Ruby Web scraping in Go Web scraping in Go Web scraping in Elixir Web scraping in Elixir Web scraping in Rust Web scraping in Rust Web scraping in Perl Web scraping in Perl No code web scraping No code web scraping No code competitor monitoring No code competitor monitoring
Web Scraping with R Tutorial: Scraping BrickEconomy.com
56 min read

Web Scraping with R Tutorial: Scraping BrickEconomy.com

In-depth R web scraping tutorial. Master data extraction with rvest, httr2, & chromote. Handle JavaScript, pagination, avoid blocks & analyze results. Code included.

Ismail Ajagbe
32 min read

ChatGPT Scraping - How to Vibe Scrape with ChatGPT

Can ChatGPT scrape the web for product data? We tested it on Apple’s refurbished store and documented the journey from vibe coding to real scraping.

Karthik Devan
20 min read

How to bypass PerimeterX anti-bot system in 2025

Learn how to bypass PerimeterX/HUMAN anti-bot system with working examples that you can use straight away to scrape the data you need.

Ilya Krukowski
11 min read

Playwright MCP - Scraping Smithery MCP database Tutorial with Cursor

Discover how AI, using Model Context Protocol (MCP), can scrape web data without code, showcasing the Playwright MCP's potential and limitations in web scraping.

Karthik Devan
27 min read

The Best Web Scraping Tools & Software in 2025

Web scraping tools & software are used to extract data from the internet. Here is our list of the best web scraping tools for 2025.

Kevin Sahin
8 min read

Web Scraping with Perl

In this tutorial, you will learn the basics of using Perl for web scraping and data extraction and parsing with the help of the TreeBuilder library.

Alexander M
24 min read

Web Scraping with Ruby

Learn web scraping with Ruby with this step-by-step tutorial. We will see the different ways to scrape the web in Ruby through lots of example gems like Nokogiri, Kimurai and HTTParty.

Ilya Krukowski
13 min read

Web Scraping with Scala - Easily Scrape and Parse HTML

This tutorial covers the main tools and techniques for web scraping in Scala. You will learn how to use the Jsoup library to parse HTML with Scala and render Javascript with Selenium.

Grzegorz Piwowarek
17 min read

BrowserUse: How to use AI Browser Automation to Scrape

Explore AI-powered browser automation with BrowserUse. Learn to scrape data, log in and create reports using Python scripts and clear step-by-step prompts.

Ilya Krukowski
21 min read

How to find all URLs on a domain’s website (multiple methods)

Crawl any website! Step-by-step guide to finding all URLs on a domain to make scraping all their content easy. Multiple methods that are easy to follow.

Ilya Krukowski
8 min read

Web Scraping in C++ with libxml2 and libcurl

In this tutorial, you’ll learn how to use C++ to implement a web scraper using libcurl and libxml2. libcurl is an API that allows you to make HTTP request, and libxml2 will help you parse HTML pages.

Alexander M
13 min read

How to Scrape With Camoufox to Bypass Antibot Technology

Discover how Camoufox, a cutting-edge web scraping technology, bypasses antibot measure to scrape any website. Learn how to scrape undetected today!

Karthik Devan
8 min read

Web Scraping in Rust with Reqwest, Scraper and Tokio

In this tutorial, you'll learn how to build a basic web scraper with Rust by scraping the top ten movies list from IMDb - a language known for its speed and safety. We'll try two approaches: blocking IO and asynchronous IO with `tokio`.

Grzegorz Piwowarek
11 min read

Best 10 Java Web Scraping Libraries

A quick and practical comparison between various web scraping Java libraries

Grzegorz Piwowarek
9 min read

How to make API calls using Python

Learn how to make API calls in Python using requests, handle responses, authenticate securely, and leverage SDKs for seamless integrations.🌟

Grzegorz Piwowarek
Next