ScrapingBee logo

The ScrapingBee Blog

We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.

Don't know where to begin?

Check out our most popular articles.

Web scraping without getting blocked Web scraping without getting blocked Web scraping in Python Web scraping in Python Web scraping in NodeJS Web scraping in NodeJS Web scraping in R Web scraping in R Web scraping in C++ Web scraping in C++ Web scraping in C# Web scraping in C# Web scraping in Php Web scraping in Php Web scraping in Scala Web scraping in Scala Java web scraping Book Java web scraping Book Web scraping in Ruby Web scraping in Ruby Web scraping in Go Web scraping in Go Web scraping in Elixir Web scraping in Elixir Web scraping in Rust Web scraping in Rust Web scraping in Perl Web scraping in Perl No code web scraping No code web scraping No code competitor monitoring No code competitor monitoring
What is HTTP?
15 min read

What is HTTP?

This article provides you with an overview on HTTP and how this technology shaped the web. It covers the different HTTP methods, the structure of an HTTP request and HTTP response, and how you can use the devtools debug HTTP issues.

Alexander M
15 min read

Getting Started with Goutte

Goutte is an excellent tool that can be used to scrape websites in PHP. In this guide, you'll give a high-level overview of how to use Goutte and explore some of its advanced capabilities.

Davis David
14 min read

Getting Started with Jaunt Java

Jaunt is an excellent tool that can be used to scrape websites in Java. In this guide, you'll give a high-level overview of how to use Jaunt and explore some of its advanced capabilities.

Kumar Harsh
10 min read

Web Scraping with Visual Basic

This tutorial will cover the main tools and techniques for web scraping in Visual Basic. You'll start by scraping a static HTML page with an HTTP client library and parsing the result with an HTML parsing library, then move on to scraping dynamic websites using a headless browser library like Puppeteer or Playwright.

Marshall Chikari
7 min read

A JavaScript Developer's Guide to curl

New JavaScript developers commonly ask if they can or need to use curl to perform HTTP requests. In this guide, you'll share some examples of how curl can be used in JavaScript.

Arek Nawo
16 min read

Web Scraping with Objective C

This tutorial covers the main tools and techniques for web scraping in Objective C.

Raji Sankar
12 min read

How to use AI for automated price scraping?

How to scrape prices from websites using ScrapingBee and AI to automatically get the price's element xPath

Rochester Oliveira
9 min read

Web Scraping with Kotlin

This tutorial covers the main tools and techniques for web scraping in Kotlin. Using the Skrape.it library, we will see how to fetch a web page, and parse the HTML to extract meaningful data.

Michael Nyamande
6 min read

The 11 best web scraping subreddits

Learn about the 11 best web scraping subreddits that can help you on your web scraping journey

Pierre de Wulf
10 min read

How to read and parse JSON data with Python

Learn how to effectively read, parse, and dump JSON data with Python.

Yasoob Khalid
6 min read

What are the 6 characteristics of a REST API?

Learn about the six characteristics that each API has to conform to in order to be considered a REST API.

Yasoob Khalid
12 min read

How to Parse HTML with Regex

Web scraping has a number of applications in the modern day software industry. This tutorial shows you how to parse HTML and extract data from the content using regular expressions (regex).

Rajkumar Venkatasamy
14 min read

Web crawling with Python

This post will show you how to crawl the web using Python. Web crawling is a powerful technique to collect data from the web by finding all the URLs for one or multiple domains

Ari Bajo
14 min read

How to scrape channel data from YouTube

Learn how to easily scrape channel data from youtube.com.

Yasoob Khalid
7 min read

Ruby HTML and XML Parsers

Web scraping comes in handy when collecting large amounts of data from the internet. This roundup shares a list of popular Ruby HTML and XML parsers that you can use to simplify web scraping.

Tahanima Chowdhury
Previous
Next