ScrapingBee logo
  • Login
  • Sign Up
  • Pricing
  • FAQ
  • Blog
  • Other Features
    • AI Web Scraping
    • Screenshots
    • Google search API
    • Data extraction
    • JavaScript scenario
    • No code web scraping
  • Developers
    • Tutorials
    • Documentation
    • Knowledge Base
  • Scrapers
    • Amazon Scraper
    • Google Shopping Scraper
    • HomeDepot Scraper
    • Walmart Scraper
    • Costco Scraper
    • Expedia Scraper
    • Google Jobs Scraper
    • Google News Scraper
    • Google Play Scraper
    • ChatGPT Scraper

The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.

Don't know where to begin?

Check out our most popular articles.

Web scraping without getting blocked Web scraping without getting blocked Web scraping in Python Web scraping in Python Web scraping in NodeJS Web scraping in NodeJS Web scraping in R Web scraping in R Web scraping in C++ Web scraping in C++ Web scraping in C# Web scraping in C# Web scraping in Php Web scraping in Php Web scraping in Scala Web scraping in Scala Java web scraping Book Java web scraping Book Web scraping in Ruby Web scraping in Ruby Web scraping in Go Web scraping in Go Web scraping in Elixir Web scraping in Elixir Web scraping in Rust Web scraping in Rust Web scraping in Perl Web scraping in Perl No code web scraping No code web scraping No code competitor monitoring No code competitor monitoring
How to Parse HTML with Regex
12 min read

How to Parse HTML with Regex

Web scraping has a number of applications in the modern day software industry. This tutorial shows you how to parse HTML and extract data from the content using regular expressions (regex).

Rajkumar Venkatasamy 05 January 2023
14 min read

Web crawling with Python

This post will show you how to crawl the web using Python. Web crawling is a powerful technique to collect data from the web by finding all the URLs for one or multiple domains

Ari Bajo 05 January 2023
14 min read

How to scrape channel data from YouTube

Learn how to easily scrape channel data from youtube.com.

Yasoob Khalid 27 December 2022
7 min read

Ruby HTML and XML Parsers

Web scraping comes in handy when collecting large amounts of data from the internet. This roundup shares a list of popular Ruby HTML and XML parsers that you can use to simplify web scraping.

Tahanima Chowdhury 16 December 2022
17 min read

Easy web scraping with Scrapy

Scrapy is the most popular Python web scraping framework. In this tutorial we will see how to scrape an E-commerce website with Scrapy from scratch.

Kevin Sahin 13 December 2022
12 min read

XPath vs CSS selectors

Looking at the differences between XPath expressions and CSS selectors. When it is best to use an XPath expression and when a CSS selector. Advantages and drawbacks of each.

Alexander M 06 December 2022
6 min read

How to use a Proxy with Ruby and Faraday

Learn how to use a proxy with Ruby and Faraday and prevent your IP from being blacklisted.

Yasoob Khalid 24 November 2022
10 min read

How to scrape data from realtor.com

Learn how to use selenium to scrape data from realtor.com and evade bot detection.

Yasoob Khalid 23 November 2022
15 min read

Using CSS Selectors for Web Scraping

We are taking a look at how CSS selectors can help us in web scraping, what their syntax is, how we build an ideal selector string, and how they are supported in mainstream languages.

Alexander M 21 November 2022
13 min read

How to scrape data from idealista

Learn how to use selenium to scrape data from Idealista and evade bot detection.

Yasoob Khalid 19 November 2022
11 min read

The 6 Best mobile and 4G proxy providers for web scraping

This post will show you the top 6 mobile and 4g proxy provider for web scraping like ScrapingBee and Airproxy.

Kevin Sahin 08 November 2022
8 min read

How to Parse HTML in Ruby with Nokogiri?

Learn to parse HTML with Ruby and Nokogiri with this step-by-step tutorial. We will see the different ways to scrape the web in Ruby through lots of example with the Nokogiri library.

Aniket Bhattacharyea 08 November 2022
9 min read

Web Scraping Booking.com

Learn how to easily scrape search listings from booking.com.

Yasoob Khalid 03 November 2022
11 min read

How to scrape data from Twitter.com

Learn how to use selenium to scrape data from Twitter.

Yasoob Khalid 26 October 2022
9 min read

Using Watir to automate web browsers with Ruby

In this tutorial, you will learn about browser automation and how to do it using Watir and Ruby.

Jude Ero 21 October 2022
Previous
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
Next

Tired of getting blocked while scraping the web?

ScrapingBee API handles headless browsers and rotates proxies for you.

Get access to 1,000 free API credits, no credit card required!

Try ScrapingBee for Free
ScrapingBee

ScrapingBee API handles headless browsers and rotates proxies for you.

Company

  • Team
  • Company's journey
  • Blog
  • Rebranding
  • Affiliate Program

Tools

  • Curl converter

Legal

  • Terms of Service
  • Privacy Policy
  • GDPR Compliance
  • Data Processing Agreement
  • Cookie Policy
  • Acceptable Use Policy
  • Legal Notices

Product

  • Features
  • Pricing
  • Status

How we compare

  • Alternative to Crawlera
  • Alternative to NetNut
  • Alternative to ScraperAPI
  • Alternatives to ScrapingBee

No code web scraping

  • No code web scraping
  • No code competitor monitoring
  • How to put scraped website data into Google Sheets
  • Send stock prices update to Slack
  • Scrape Amazon products' price with no code
  • Scrape Amazon products' price with no code
  • Extract job listings, details and salaries

Learning Web Scraping

  • Web scraping questions
  • A guide to Web Scraping without getting blocked
  • Web Scraping Tools
  • Best Free Proxies
  • Best Mobile proxies
  • Web Scraping vs Web Crawling
  • Rotating and residential proxies
  • Web Scraping with Python
  • Web Scraping with PHP
  • Web Scraping with Java
  • Web Scraping with Ruby
  • Web Scraping with NodeJS
  • Web Scraping with R
  • Web Scraping with C#
  • Web Scraping with C++
  • Web Scraping with Elixir
  • Web Scraping with Perl
  • Web Scraping with Rust
  • Web Scraping with Go

Copyright © 2025

Made in France