Stories from the Web Crawling trenches in async IO

Async IO in Python: When and Why to Use It Over Threads

Author: Mohan Ganesan

Date: Mar 17, 2024

Leverage async I/O for non-CPU bound tasks that deal with network, disk, or user interactions for great performance gains. Stick to threads for intensive computational workloads.

Is asyncio python better than threading?

Author: Mohan Ganesan

Date: Mar 17, 2024

Async IO vs Threading in Python: A Practical Comparison. Async IO and threading are two options for concurrency in Python. This article compares their strengths and weaknesses, including performance, scalability, and library compatibility.

Async IO in Python with aiohttp

Author: Mohan Ganesan

Date: Mar 3, 2024

aiohttp brings the performance benefits of async I/O to Python web development while retaining a simple, Pythonic API.

Async IO and Generators: Key Differences in Python

Author: Mohan Ganesan

Date: Mar 24, 2024

Async IO and generators are powerful asynchronous programming concepts in Python with key differences. Generators produce data on demand, while Async IO enables concurrent work. Both are useful for different scenarios and can be used together to write highly scalable programs.

Choosing Between Curio and aiohttp for Async IO in Python

Author: Mohan Ganesan

Date: Feb 22, 2024

Python developers can choose between Curio and aiohttp for async IO. Curio is great for CPU-bound tasks, while aiohttp is ideal for IO-bound HTTP applications. Both libraries are well-optimized for performance.

Is asyncio a standard library python ?

Author: Mohan Ganesan

Date: Mar 17, 2024

Async IO is a useful concurrent programming framework in Python's standard library for executing multiple tasks concurrently within a single thread.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!