Stories from the Web Crawling trenches in web resources

What is the difference between URL and API?

Author: Mohan Ganesan

Date: May 7, 2024

URLs handle locating web assets, while APIs handle application integration. Both serve important, yet distinct roles in modern web technologies.

Accessing Websites in Python with urllib.request.urlopen

Author: Mohan Ganesan

Date: Feb 6, 2024

The urllib.request module in Python 3 provides a simple way to access and download data from websites via HTTP and HTTPS.

Accessing Websites in Python with urllib.urlopen()

Author: Mohan Ganesan

Date: Feb 6, 2024

The urllib.urlopen() function in Python provides a simple way to access and retrieve data from websites. It is useful for fetching data from web APIs, scraping data from HTML web pages, testing connectivity, and downloading files. It handles most of the network request work automatically.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!

Try ProxiesAPI for free

Tired of getting blocked while scraping the web?

Get access to 1,000 free API credits, no credit card required!

Try for free