Stories from the Web Crawling trenches in request

Sending HTTP Requests in Python: Request vs Requests

Author: Mohan Ganesan

Date: Feb 3, 2024

Python applications often require HTTP requests. The request library is built-in, while requests is a more powerful third-party library that simplifies the process.

Web Scraping New York Times News Headlines with Node.js

Author: Mohan Ganesan

Date: Dec 6, 2023

Scrape New York Times articles using Node.js modules like request and cheerio to extract structured data for various applications.

Getting Started with the HTTPX Python Library

Author: Mohan Ganesan

Date: Feb 5, 2024

The HTTPX library is a powerful and user-friendly HTTP client for Python. Install it with pip and make requests easily with its elegant API.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!