Stories from the Web Crawling trenches in XPath expressions

CSS Selectors vs XPath with BeautifulSoup: How to Choose the Right Selector

Author: Mohan Ganesan

Date: Oct 6, 2023

CSS selectors and XPath expressions are powerful techniques for parsing and extracting data from HTML and XML. CSS selectors offer simplicity and readability, while XPath provides unmatched query power and flexibility. Combining both can give you a robust toolkit for efficient data extraction.

Scraping Multiple Pages in Scala with HTTP Client and XML Libraries

Author: Mohan Ganesan

Date: Oct 15, 2023

Web scraping in Scala using HTTP client and XML libraries to extract data from multiple pages. Use XPath expressions and proxies for scalability.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!