Stories from the Web Crawling trenches in multipart file uploads

Using httpx's AsyncClient for Asynchronous HTTP POST Requests

Author: Mohan Ganesan

Date: Feb 5, 2024

The httpx library in Python provides an AsyncClient class that makes it easy to send asynchronous HTTP requests without having to deal with some of the complexity of asyncio directly.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!