The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorial, case studies and
writing by industry experts

Articles marked with a  â­ï¸  are our best articles

Starting with web-scraping?

Whichever language you like, we got you covered with those tutorials:

How to download a file with Puppeteer?
How to download a file with Puppeteer? - (7min)
By Kevin Sahin 23 April 2021

There are different ways to download a file with Puppeteer. Unfortunately, all of the different techniques are not well documented. We will go through several practical examples of file dowloading with Puppeteer.

read more
HTTP headers with axios
HTTP headers with axios - (7min)
By Kevin Sahin 15 January 2021

This post will show you how to send HTTP headers with Axios. We will see different examples with GET and POST requests on how to set your headers with Axios.

read more
Web crawling with Python
Web crawling with Python - (13min)
By Ari Bajo 11 December 2020

This post will show you how to crawl the web using Python. Web crawling is a powerful technique to collect data from the web by finding all the URLs for one or multiple domains

read more
Web Scraping with node-fetch
Web Scraping with node-fetch - (8min)
By Shenesh Perera 03 December 2020

In this tutorial we will see how to use the node-fetch package for web scraping. We will learn what the fetch API is and the different ways to use the package.

read more
Web Scraping with C#
⭐️ Web Scraping with C# - (12min)
By Jennifer Marsh 05 October 2020

Learn web scraping with C# with this step-by-step tutorial covering the must-known C# web-scraping tools and libraries.

read more
Web Scraping with PHP
⭐️ Web Scraping with PHP - (14min)
By Jérôme Gamez 22 September 2020

Learn web scraping with PHP with this step-by-step tutorial covering the must-known PHP web-scraping tools and libraries.

read more
Web Scraping with Ruby
⭐️ Web Scraping with Ruby - (18min)
By Sylwia vargas 18 June 2020

Learn web scraping with Ruby with this step-by-step tutorial. We will see the different ways to scrape the web in Ruby through lots of example with gems like Nokogiri, Kimurai and HTTParty.

read more
Web Scraping with R
⭐️ Web Scraping with R - (15min)
By Parikshit Joshi 05 May 2020

Learn web scraping with R with this step-by-step tutorial. We will see the different ways to scrape the web in R through lots of example.

read more
Tired of getting blocked while scraping the web? Our API handles headless browsers and rotates proxies for you.