Stories from the Web Crawling trenches in data parameter

Sending JSON vs Form Data in Python Requests

Author: Mohan Ganesan

Date: Feb 3, 2024

When making HTTP requests in Python using the requests module, you can send request bodies in different formats like JSON or form-urlencoded data.

Sending POST Requests with the Python Requests Library by Specifying GET

Author: Mohan Ganesan

Date: Feb 3, 2024

Override the method parameter in Python Requests library to make a POST request even if specified as GET.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!

Try ProxiesAPI for free

Tired of getting blocked while scraping the web?

Get access to 1,000 free API credits, no credit card required!

Try for free