Stories from the Web Crawling trenches in module

Easy Guide to Installing urllib in Python

Author: Mohan Ganesan

Date: Feb 6, 2024

The urllib module in Python allows you to open and read URLs. It is included in the Python standard library and works with Python 2.7.9+ and Python 3.4+. Import urllib.request to use it. Use urlopen() to make GET requests.

import aiohttp modulenotfounderror: no module named 'aiohttp'

Author: Mohan Ganesan

Date: Feb 22, 2024

When working with Python, you may encounter an error when importing the aiohttp module. This article provides solutions to fix the import error.

Importing BeautifulSoup in Python

Author: Mohan Ganesan

Date: Oct 6, 2023

The first step in any BeautifulSoup web scraping script is importing the module and initializing the soup object to parse the HTML content.

Is BeautifulSoup a library or module?

Author: Mohan Ganesan

Date: Feb 5, 2024

BeautifulSoup is a library in Python for parsing, navigating, and searching HTML and XML documents.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!