Stories from the Web Crawling trenches in urllib.parse

URL Parsing in Python with urllib.parse

Author: Mohan Ganesan

Date: Feb 6, 2024

Understanding and manipulating URLs is crucial for Python web programming. The urllib.parse module provides functions for parsing, composing, and manipulating URLs in Python.

URL Encoding and Decoding in Python

Author: Mohan Ganesan

Date: Feb 6, 2024

URL encoding/decoding in Python using urllib.parse. quote() encodes special characters like spaces as %20, while unquote() decodes them. Useful for building and parsing URLs.

What are the 3 parts to a URL in Python?

Author: Mohan Ganesan

Date: Feb 20, 2024

Understanding URLs is key for web development in Python. URLs have three main components: protocol, domain name, and path. Python provides modules for working with URLs.

How to use URL in Python?

Author: Mohan Ganesan

Date: Feb 20, 2024

Python has great URL handling capabilities out of the box. Whether you need to parse URLs, download files, call web APIs, or interact with websites, Python has you covered!

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!