Stories from the Web Crawling trenches in XPath queries

Scraping Multiple Pages in Perl with LWP::UserAgent and HTML::TreeBuilder

Author: Mohan Ganesan

Date: Oct 15, 2023

Web scraping in Perl using LWP::UserAgent and HTML::TreeBuilder modules to extract data from multiple pages. Use XPath queries and proxies for efficient data extraction.

Scraping Multiple Pages in Visual Basic with HtmlAgilityPack and HttpClient

Author: Mohan Ganesan

Date: Oct 15, 2023

Web scraping in Visual Basic using HtmlAgilityPack and HttpClient libraries to extract data from multiple pages. Use XPath queries and proxies for efficient data extraction.

Scraping New York Times News Headlines in VB

Author: Mohan Ganesan

Date: Dec 6, 2023

Web scraping is the process of extracting data from websites automatically through code. This article provides a step-by-step guide on how to scrape article titles and links from The New York Times website using HTML parsing and XPath queries.

Scraping Multiple Pages in Objective-C with NSURLSession and XPathQuery

Author: Mohan Ganesan

Date: Oct 15, 2023

Scrape multiple pages in Objective-C using NSURLSession and XPathQuery to extract data programmatically from websites.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!