Stories from the Web Crawling trenches in framework

Can I create my own API?

Author: Mohan Ganesan

Date: May 7, 2024

Build your own API to share data, split up services, and reuse abilities. Choose a framework, design endpoints, connect data sources, write handler code, test API calls, add security, and deploy API.

Is Scrapy faster than BeautifulSoup?

Author: Mohan Ganesan

Date: Feb 5, 2024

Scrapy is a faster dedicated web scraping framework while BeautifulSoup excels at parsing HTML/XML.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!