Stories from the Web Crawling trenches in load balancing

Using aiohttp for Easy and Powerful Reverse Proxying in Python

Author: Mohan Ganesan

Date: Mar 3, 2024

Reverse proxying with aiohttp in Python allows for load balancing, caching, security, and more. ProxyResolver and ProxyConnector provide customization options.

Making the Most of Proxies in aiohttp for Python

Author: Mohan Ganesan

Date: Feb 22, 2024

Learn how to use proxies with the aiohttp library in Python for privacy, geographic access, load balancing, and scraping.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!

Try ProxiesAPI for free

Tired of getting blocked while scraping the web?

Get access to 1,000 free API credits, no credit card required!

Try for free