Stories from the Web Crawling trenches in TLS

How to fix SSLError in Python requests

Author: Mohan Ganesan

Date: Oct 22, 2023

Properly handle SSL errors in Python requests by updating CA bundles, fixing certificates, and using TLS 1.2+. Use SSLContext for full control over SSL behavior.

Troubleshooting the WinError 10061 with Python Requests

Author: Mohan Ganesan

Date: Feb 3, 2024

Encountering WinError 10061 when using Python's requests module? Check for firewall issues, verify TLS versions, and ensure proper name resolution.

Making HTTP Requests Through a Proxy in Elixir with HTTPoison in 2024

Author: Mohan Ganesan

Date: Jan 9, 2024

Learn how to install HTTPoison in Elixir, make requests, configure global and per-request proxies, use SOCKS proxies, handle authentication and TLS, and manage IP blocks and captchas with proxy rotation services.

TLS Support in Python's urllib3

Author: Mohan Ganesan

Date: Feb 8, 2024

urllib3 library supports TLS v1.2 and TLS v1.3 by default, ensuring secure connections in Python. Beware of outdated TLS versions and upgrade urllib3 for security.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!