The ScrapingBee Blog

Using a proxy with cURL is easy. This step-by-step tutorial will show you the three different ways to set up a proxy server with cURL command line tool.

Python POST data using requests package. This article will teach you how to POST JSON data with Python Requests library.

Data parsing is the process of taking data in one format and transforming it to another format. This is particulary interesting for web scraping.

This article will show you how to intercept and block requests with Puppeteer using the request interception API and the puppeteer extra plugin.

What is the difference between web scraping and web crawling? That's exactly what we will discover in this article, and the different tools you can use.

Submitting a form with Puppeteer can be tricky. In this article, we will show the different way to submit a simple form, but also with attachments.

This article will discuss the best HTTP clients in Ruby. Faraday, HTTParty, Rest-client...it can be hard to choose the best one.

There are different ways to download a file with Puppeteer. Unfortunately, all of the different techniques are not well documented. We will go through several practical examples of file dowloading with Puppeteer.

Learn how to scrape the web with Playwright. We will see the different ways to scrape the web with Playwright through lots of example.

In this post you will find the 5 best rotating and residential proxies for Web Scraping. 1) ScrapingBee 2) Luminati 3) Oxylabs 4) Smartproxy 5) Crawlera

This post will show you the top 5 free proxy lists available on the web: ScrapingBee, ProxyScrape, FreeproxylistCZ and more.

This article will teach you to extract data from the web easily. There are many ways to pull data from websites, from web scraping tools to in-house pipeline. This post will show you exactly what's the best solution to your web scraping problem.

This post will show you how to send HTTP headers with Axios. We will see different examples with GET and POST requests on how to set your headers with Axios.

In this tutorial we will see how to use the node-fetch package for web scraping. We will learn what the fetch API is and the different ways to use the package.