Stories from the Web Crawling trenches in Downloading files

Downloading Files with Python Requests - Tips, Tricks and Code Example

Author: Mohan Ganesan

Date: Oct 31, 2023

Learn how to use Python Requests to download files from the web with ease. Requests provides a simple API for making HTTP calls, supports advanced features like streaming downloads and authentication, and is actively maintained. Use Requests to download files like a pro!

Downloading Files in Python with aiohttp

Author: Mohan Ganesan

Date: Feb 22, 2024

Python's aiohttp library allows for asynchronous and non-blocking downloading of files. It provides a simple API, handles streams efficiently, and supports progress reporting and error handling.

Downloading Files in Python with urllib

Author: Mohan Ganesan

Date: Feb 6, 2024

The urllib module in Python 3 provides functionality for downloading files. Learn how to use urllib to download and save files, handle redirects, and implement file downloads in Python.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!