Stories from the Web Crawling trenches in code

Web Scraping using ChatGPT - Complete Guide with Examples

Author: Mohan Ganesan

Date: Sep 25, 2023

Web scraping using ChatGPT: extract data from websites using code. ChatGPT is a powerful tool for web scraping. Techniques include using Selenium and Beautiful Soup. Get started now!

How to Build a Super Simple HTTP Proxy in C++ in just 30 lines of code

Author: Mohan Ganesan

Date: Oct 1, 2023

Build a basic HTTP proxy in C++ in 30 lines of code. Use a rotating proxy service to avoid IP blocking with an API.

Scraping Reddit Posts with Rust

Author: Mohan Ganesan

Date: Jan 9, 2024

Code walkthrough for scraping Reddit using Rust to extract post information.

Is REST API a code?

Author: Mohan Ganesan

Date: May 7, 2024

REST API is an architectural style for building web services, not a coding framework. It requires writing code for routing, controllers, models, etc.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!