Stories from the Web Crawling trenches in Python developers

Async IO in Python: Trio vs. Asyncio

Author: Mohan Ganesan

Date: Mar 25, 2024

Python developers have two main options for asynchronous I/O concurrency - asyncio and Trio. Both allow you to write non-blocking, concurrent code in Python. But which one is better for your use case?

Async HTTP Clients: aiohttp vs httpx

Author: Mohan Ganesan

Date: Feb 22, 2024

Python developers often make HTTP requests to access APIs and web services. Two popular async HTTP client libraries for Python are aiohttp and httpx. This article compares the two libraries and discusses their key differences, features, and performance. The choice between aiohttp and httpx depends on specific needs, such as client/server use cases, HTTP/2 support, ease of use, and control over limits and configuration.

Is Python web scraping in demand?

Author: Mohan Ganesan

Date: Feb 20, 2024

Web scraping is the automated process of extracting data from websites. Python's simplicity and libraries make it ideal for web scraping, leading to high demand for Python web scraping skills.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!