The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorials, case studies and
writings by industry experts

Articles marked with a  ⭐️  are our best articles

Starting with web-scraping?

Whichever language you like, we got you covered with those tutorials:

Web Scraping with Go
⭐️ Web Scraping with Go - (10min)
By Subha Chanda 17 November 2021

Learn web scraping with Go with this step-by-step tutorial. We will see the different ways to scrape the web in Go through lots of example with librairies like GoColly and GoQuery.

read more
Using wget with a proxy
Using wget with a proxy - (8min)
By Maxine Meurer 27 September 2021

Using a proxy with wget is easy. This step-by-step tutorial will show you the three different ways to set up a proxy server with wget command line tool.

read more
Using cURL with a proxy
Using cURL with a proxy - (8min)
By Kevin Sahin 14 July 2021

Using a proxy with cURL is easy. This step-by-step tutorial will show you the three different ways to set up a proxy server with cURL command line tool.

read more
What is data parsing?
What is data parsing? - (10min)
By Kevin Sahin 07 June 2021

Data parsing is the process of taking data in one format and transforming it to another format. This is particulary interesting for web scraping.

read more
How to download a file with Puppeteer?
How to download a file with Puppeteer? - (7min)
By Kevin Sahin 23 April 2021

There are different ways to download a file with Puppeteer. Unfortunately, all of the different techniques are not well documented. We will go through several practical examples of file dowloading with Puppeteer.

read more
HTTP headers with axios
HTTP headers with axios - (7min)
By Kevin Sahin 15 January 2021

This post will show you how to send HTTP headers with Axios. We will see different examples with GET and POST requests on how to set your headers with Axios.

read more
Web crawling with Python
Web crawling with Python - (13min)
By Ari Bajo 11 December 2020

This post will show you how to crawl the web using Python. Web crawling is a powerful technique to collect data from the web by finding all the URLs for one or multiple domains

read more
Web Scraping with node-fetch
Web Scraping with node-fetch - (8min)
By Shenesh Perera 03 December 2020

In this tutorial we will see how to use the node-fetch package for web scraping. We will learn what the fetch API is and the different ways to use the package.

read more
Web Scraping with Ruby
⭐️ Web Scraping with Ruby - (18min)
By Sylwia vargas 18 June 2020

Learn web scraping with Ruby with this step-by-step tutorial. We will see the different ways to scrape the web in Ruby through lots of example with gems like Nokogiri, Kimurai and HTTParty.

read more
Web Scraping with R
⭐️ Web Scraping with R - (15min)
By Parikshit Joshi 05 May 2020

Learn web scraping with R with this step-by-step tutorial. We will see the different ways to scrape the web in R through lots of example.

read more
Tired of getting blocked while scraping the web? Our API handles headless browsers and rotates proxies for you.