You can find all links using DOM Crawler and PHP by making use of either the filter or the filterXPath method. Below, you can find two code samples that demonstrate how to use either of these methods. The code uses Guzzle to load the ScrapingBee website so you may want to install that as well using Composer.
This example code uses the filter method:
use Symfony\Component\DomCrawler\Crawler;
use GuzzleHttp\Client;
// Create a client to make the HTTP request
$client = new \GuzzleHttp\Client();
$response = $client->get('https://www.scrapingbee.com/');
$html = (string) $response->getBody();
// Load the HTML document
$crawler = new Crawler($html);
// Find all links on the page
$links = $crawler->filter('a');
// Loop over the links and print their href attributes
foreach ($links as $link) {
echo $link->getAttribute('href') . PHP_EOL;
}
// Output:
// /
// https://app.scrapingbee.com/account/login
// https://app.scrapingbee.com/account/register
// /#pricing
// /#faq
// /blog/
// #
// /features/screenshot/
// /features/google/
// ...
This example code uses filterXPath method:
use Symfony\Component\DomCrawler\Crawler;
use GuzzleHttp\Client;
// Create a client to make the HTTP request
$client = new \GuzzleHttp\Client();
$response = $client->get('https://www.scrapingbee.com/');
$html = (string) $response->getBody();
// Load the HTML document
$crawler = new Crawler($html);
// Find all links on the page
$links = $crawler->filterXPath('//a');
// Loop over the links and print their href attributes
foreach ($links as $link) {
echo $link->getAttribute('href') . PHP_EOL;
}
// Output:
// /
// https://app.scrapingbee.com/account/login
// https://app.scrapingbee.com/account/register
// /#pricing
// /#faq
// /blog/
// #
// /features/screenshot/
// /features/google/
// ...