Stories from the Web Crawling trenches in configuring retries

The Complete Guide to Retrying Failed Requests with Axios

Author: Mohan Ganesan

Date: Jan 9, 2024

Automated retries using Axios interceptors provide reliability, speed, scalability, and resilience. Configuring retries involves setting the number of retries, delay between retries, and conditional retries. The Axios-Retry plugin simplifies the process. Other libraries like retry-axios offer similar capabilities. Testing and debugging retry logic is important, and caution must be taken to avoid circular retries. Axios is widely used in React apps and can be used for any HTTP backend. Automated retries are essential for building robust apps that handle remote services.

Retrying Failed Requests in Python Requests (with Code Examples!)

Author: Mohan Ganesan

Date: Oct 31, 2023

Learn how to implement a robust retry mechanism for handling request failures in Python using the Requests library. Understand different types of failures, configure retries with Sessions and HTTPAdapter, and build a custom retry wrapper. Improve the reliability of your applications despite network and server issues.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!