Stories from the Web Crawling trenches in data retrieval

Is Urllib in Python standard library?

Author: Mohan Ganesan

Date: Feb 20, 2024

Python's built-in urllib module makes retrieving data from the internet easy. It's a great starting point for basic HTTP requests before using more full-featured libraries like Requests.

Is API better than web scraping?

Author: Mohan Ganesan

Date: Feb 20, 2024

APIs vs web scraping: pros and cons of structured data retrieval and HTML parsing for flexible data access.

Fetching Data from the Web with urllib's read()

Author: Mohan Ganesan

Date: Feb 8, 2024

Python's urllib module provides a simple way to retrieve data from the internet using the read() method. It handles network I/O and allows you to focus on working with the downloaded data.

urllib retrieve

Author: Mohan Ganesan

Date: Feb 8, 2024

urllib in Python makes it easy to fetch resources from the web. Handle errors and include data in requests with URL encoding.

Is SQL an API?

Author: Mohan Ganesan

Date: May 7, 2024

SQL is a language for managing data in databases, while APIs facilitate data transmission between systems. SQL and APIs have key differences but can complement each other in application development.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!