Stories from the Web Crawling trenches in concurrent code

Leveraging Asynchronous I/O with Asyncio for Faster File Operations

Author: Mohan Ganesan

Date: Mar 25, 2024

Asynchronous I/O in Python with asyncio allows non-blocking file operations, optimizing applications with concurrent code and faster file processing.

How asyncio works in Python?

Author: Mohan Ganesan

Date: Mar 24, 2024

Python's asyncio module allows for writing concurrent code using async/await syntax. It provides an event loop, async functions, and the ability to run awaitables concurrently with asyncio.gather().

Asyncio gather usage

Author: Mohan Ganesan

Date: Mar 25, 2024

The asyncio module in Python provides powerful tools for writing asynchronous and concurrent code. One very useful function is asyncio.gather(), which allows you to simplify running multiple coroutines concurrently.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!