Stories from the Web Crawling trenches in server response

How to fix ReadTimeout error in Python requests

Author: Mohan Ganesan

Date: Oct 22, 2023

Overview of ReadTimeout Error. A ReadTimeout error occurs when making requests using the Python requests module and indicates that the server failed to send any data in the allotted timeout period.

Uploading Zip Files via HTTP POST with Python Requests

Author: Mohan Ganesan

Date: Feb 3, 2024

Sending zip files over HTTP using Python's Requests library with multipart form data for efficient file upload and server processing.

Sending POST Requests with the Python Requests Library by Specifying GET

Author: Mohan Ganesan

Date: Feb 3, 2024

Override the method parameter in Python Requests library to make a POST request even if specified as GET.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!

Try ProxiesAPI for free

Tired of getting blocked while scraping the web?

Get access to 1,000 free API credits, no credit card required!

Try for free