Stories from the Web Crawling trenches in thread pools

Speed Up Your Asyncio Code with Thread Pools

Author: Mohan Ganesan

Date: Mar 25, 2024

Asyncio is great for writing non-blocking network code in Python. But sometimes you have CPU-bound tasks that could benefit from parallel execution. That's where thread pools come in handy!

Async IO vs Thread Pools in Python: When to Use Each

Author: Mohan Ganesan

Date: Mar 17, 2024

Python provides two major approaches for concurrent and parallel programming: asyncio and thread pools. Choosing the right concurrency tool can impact performance, scalability, and code complexity.

Understanding Multithreading Models: Green, Native, and Pool

Author: Mohan Ganesan

Date: Mar 24, 2024

Multithreading enables parallel execution, with green threads managed by runtime, native threads by OS, and thread pools for task execution.

What is the fastest language for multithreading?

Author: Mohan Ganesan

Date: Mar 17, 2024

Multithreading improves performance. C++, Java, and Go are fastest. Optimize with thread pools, shared state, and reducing blocking.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!