Stories from the Web Crawling trenches in Request object

Understanding the Aiohttp Request Object in Python

Author: Mohan Ganesan

Date: Mar 3, 2024

The aiohttp request object provides valuable information about incoming HTTP requests in Python web applications.

Simplifying HTTP Requests in Python with urllib

Author: Mohan Ganesan

Date: Feb 3, 2024

The urllib module in Python provides tools for fetching data from the web. It allows making HTTP requests, handling responses, and constructing customized requests.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!