Stories from the Web Crawling trenches in Session object

Mastering Python Requests Sessions for Power Users

Author: Mohan Ganesan

Date: Oct 22, 2023

The Python requests library provides a powerful Session object for handling HTTP requests. Sessions allow you to persist settings, reuse connections, and handle cookies automatically.

Why You May Not Get All Cookie Data with the Python Requests Module

Author: Mohan Ganesan

Date: Feb 3, 2024

Use Sessions or custom jars to ensure you have full cookie details when using Requests.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!