Stories from the Web Crawling trenches in 404 errors

Handling 404 Errors when Making HTTP Requests in Python

Author: Mohan Ganesan

Date: Feb 3, 2024

Tips on handling 404 errors gracefully in Python code when making HTTP requests. Check response status code, log and notify, use try-except block.

httpnotfound aiohttp

Author: Mohan Ganesan

Date: Feb 22, 2024

Handle 404 errors in web applications using Python aiohttp framework, with custom error handler and templating for a better user experience.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!

Try ProxiesAPI for free

Tired of getting blocked while scraping the web?

Get access to 1,000 free API credits, no credit card required!

Try for free