Stories from the Web Crawling trenches in HTTParty

Downloading Images from URLs in Ruby

Author: Mohan Ganesan

Date: May 5, 2024

Learn how to download images from URLs using Ruby with OpenURI, Net::HTTP, HTTParty, Down, and Faraday.

Scraping Real Estate Listings From Realtor with Ruby

Author: Mohan Ganesan

Date: Jan 9, 2024

Learn how to use Ruby and the Nokogiri and HTTParty gems for web scraping, specifically for extracting real estate listing data from Realtor.com.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!