Stories from the Web Crawling trenches in Python BeautifulSoup

Find the text of the given tag using BeautifulSoup

Author: Mohan Ganesan

Date: Oct 6, 2023

The get_text() method in Python BeautifulSoup library is useful for extracting text from HTML and XML documents. It strips HTML tags, handles whitespace and nested tags, and ignores invisible text.

Difference Between find() and find_all() in BeautifulSoup

Author: Mohan Ganesan

Date: Oct 6, 2023

The find() and find_all() methods in Python BeautifulSoup library are used for searching and extracting elements from HTML and XML documents. find() returns the first matching element, while find_all() returns a list of all matching elements.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!