Stories from the Web Crawling trenches in web automation

Automating Web Interactions in Python with Requests

Author: Mohan Ganesan

Date: Feb 3, 2024

Automate web interactions with Python Requests library. Easily submit forms, scrape data, and click buttons programmatically.

Playwright vs Puppeteer: A Side-by-Side Comparison for Test Automation

Author: Mohan Ganesan

Date: Jan 9, 2024

Playwright and Puppeteer are popular browser testing tools that offer speed, capabilities, and reliability. Playwright has an advantage in terms of speed, browser support, and API design. Both tools are suitable for web app testing, but Puppeteer is recommended for web scraping tasks.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!