Stories from the Web Crawling trenches in IO-bound tasks

Why Python's Multithreading Perfoms Poorly (And What To Do About It)

Author: Mohan Ganesan

Date: Mar 24, 2024

Python's multithreading capabilities are limited due to the GIL. Solutions like multiprocessing and asynchronous frameworks exist.

Is asyncio a standard library python ?

Author: Mohan Ganesan

Date: Mar 17, 2024

Async IO is a useful concurrent programming framework in Python's standard library for executing multiple tasks concurrently within a single thread.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!