Stories from the Web Crawling trenches in privacy

Making the Most of Proxies in aiohttp for Python

Author: Mohan Ganesan

Date: Feb 22, 2024

Learn how to use proxies with the aiohttp library in Python for privacy, geographic access, load balancing, and scraping.

The Definitive Guide to Handling Proxies in Go in 2024

Author: Mohan Ganesan

Date: Jan 9, 2024

Dealing with proxies in Go for web scraping: setup, security, privacy, performance, and troubleshooting. Proxies API offers a solution for developers.

Is VPN good for scraping?

Author: Mohan Ganesan

Date: Feb 20, 2024

Using a VPN for web scraping can provide privacy and access benefits, but it may also slow down page load times and have usage limits.

What is the future of web scraping?

Author: Mohan Ganesan

Date: Feb 22, 2024

Web scraping trends include automation tools, data ownership debates, JavaScript-heavy sites, and privacy concerns.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!