Stories from the Web Crawling trenches in CSV

Reading CSV Files with Python's urllib

Author: Mohan Ganesan

Date: Feb 8, 2024

CSV files can be easily downloaded and parsed using Python's urllib module. It is useful for data analysis, data integration, and streaming large CSV files.

Web Scraping with Elixir & ChatGPT

Author: Mohan Ganesan

Date: Sep 25, 2023

Elixir is a great language for web scraping with ChatGPT. HTTPoison and Floki are useful libraries. ChatGPT provides explanations and code snippets. Proxies API is a robust solution for web scraping.

What are the three basic parts of a scraper?

Author: Mohan Ganesan

Date: Feb 22, 2024

Web scrapers allow you to programmatically extract data from websites, transform it into a structured format like a CSV or JSON file, and save it to your computer for further analysis.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!