The ScrapingBee Blog
We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.
Don't know where to begin?
Check out our most popular articles.
What is data parsing?
Data parsing is the process of taking data in one format and transforming it to another format. This is particulary interesting for web scraping.
Block ressources with Puppeteer
This article will show you how to intercept and block requests with Puppeteer using the request interception API and the puppeteer extra plugin.
Web Scraping vs Web Crawling: Ultimate Guide
What is the difference between web scraping and web crawling? That's exactly what we will discover in this article, and the different tools you can use.
How to submit a form with Puppeteer?
Submitting a form with Puppeteer can be tricky. In this article, we will show the different way to submit a simple form, but also with attachments.
The Best Ruby HTTP clients for 2021
This article will discuss the best HTTP clients in Ruby. Faraday, HTTParty, Rest-client...it can be hard to choose the best one.
How to download a file with Puppeteer?
There are different ways to download a file with Puppeteer. Unfortunately, all of the different techniques are not well documented. We will go through several practical examples of file dowloading with Puppeteer.
Scraping the web with Playwright
Learn how to scrape the web with Playwright. We will see the different ways to scrape the web with Playwright through lots of example.
BeautifulSoup tutorial: Scraping web pages with Python
In this tutorial, we will learn how to scrape the web using BeautifulSoup and CSS selectors with step-by-step instructions.
Top 5 Rotating and Residential Proxies for Web Scraping
In this post you will find the 5 best rotating and residential proxies for Web Scraping. 1) ScrapingBee 2) Luminati 3) Oxylabs 4) Smartproxy 5) Crawlera
Web Scraping with Python: Everything you need to know (2021)
Learn web scraping with Python with this step-by-step tutorial. We will cover almost all of the tools Python offers to scrape the web. From Requests to BeautifulSoup, Scrapy, Selenium and more.
The 5 Best Free Proxy Lists for Web Scraping
This post will show you the top 5 free proxy lists available on the web: ScrapingBee, ProxyScrape, FreeproxylistCZ and more.
How to extract data from a website? Ultimate guide to pull data from any website
This article will teach you to extract data from the web easily. There are many ways to pull data from websites, from web scraping tools to in-house pipeline. This post will show you exactly what's the best solution to your web scraping problem.
The 5 Best mobile and 4G proxy providers for web scraping
This post will show you the top 5 mobile and 4g proxy provider for web scraping like ScrapingBee and Airproxy.