Stories from the Web Crawling trenches in urllib.request

Accessing Websites in Python with urllib.request.urlopen

Author: Mohan Ganesan

Date: Feb 6, 2024

The urllib.request module in Python 3 provides a simple way to access and download data from websites via HTTP and HTTPS.

Is Urllib built in Python?

Author: Mohan Ganesan

Date: Feb 20, 2024

Python's urllib module provides the building blocks for fetching data and interacting with APIs over HTTP.

Downloading Images from URLs in Python

Author: Mohan Ganesan

Date: May 5, 2024

Learn five different ways to download images from URLs using Python: urllib.request, requests, urllib3, wget, and PyCURL.

How to use URL in Python?

Author: Mohan Ganesan

Date: Feb 20, 2024

Python has great URL handling capabilities out of the box. Whether you need to parse URLs, download files, call web APIs, or interact with websites, Python has you covered!

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!