Stories from the Web Crawling trenches in asyncio module

Making Asynchronous HTTP Requests in Python without Waiting for a Response

Author: Mohan Ganesan

Date: Feb 3, 2024

Make asynchronous HTTP requests in Python without blocking using the requests library, asyncio module, or threads/processes.

Async IO Sleep vs Time Sleep in Python - When to Use Each

Author: Mohan Ganesan

Date: Mar 17, 2024

When writing asynchronous Python code, use asyncio.sleep() for delays without blocking, and time.sleep() for pausing all processing in the current thread.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!