The ScrapingBee Blog
We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.
Don't know where to begin?
Check out our most popular articles.
Web Scraping with Visual Basic
This tutorial will cover the main tools and techniques for web scraping in Visual Basic. You'll start by scraping a static HTML page with an HTTP client library and parsing the result with an HTML parsing library, then move on to scraping dynamic websites using a headless browser library like Puppeteer or Playwright.
Web Scraping with Objective C
This tutorial covers the main tools and techniques for web scraping in Objective C.
How to use AI for automated price scraping?
How to scrape prices from websites using ScrapingBee and AI to automatically get the price's element xPath
Python HTML Parsers
Web scraping comes in handy when collecting large amounts of data from the internet. This roundup shares a list of popular Python HTML parsers you can use to simplify web scraping.
Web Scraping with Kotlin
This tutorial covers the main tools and techniques for web scraping in Kotlin. Using the Skrape.it library, we will see how to fetch a web page, and parse the HTML to extract meaningful data.
How to build a job board with web scraping and ChatGPT
Learn how to collect job openings by scraping Google and recruiting software sites, and then extract useful information such as salary and benefits using ChatGPT.
The 11 best web scraping subreddits
Learn about the 11 best web scraping subreddits that can help you on your web scraping journey
Web Scraping with Scala
How to read and parse JSON data with Python
Learn how to effectively read, parse, and dump JSON data with Python.
What are the 6 characteristics of a REST API?
Learn about the six characteristics that each API has to conform to in order to be considered a REST API.
API for dummies: learning the basics of API
Learn about the basics of APIs and the different kinds of APIs that are available to use.
How to Parse HTML with Regex
Web scraping has a number of applications in the modern day software industry. This tutorial shows you how to parse HTML and extract data from the content using regular expressions (regex).
Web crawling with Python
This post will show you how to crawl the web using Python. Web crawling is a powerful technique to collect data from the web by finding all the URLs for one or multiple domains