Stories from the Web Crawling trenches in client

Setting Cookies in aiohttp Requests

Author: Mohan Ganesan

Date: Mar 3, 2024

Set cookies in Python aiohttp requests to handle sessions, authorization, or preferences. aiohttp seamlessly handles cookies for easy automation and scripting.

Which is the best Python library for sending SOAP requests

Author: Mohan Ganesan

Date: Feb 3, 2024

The zeep library is the easiest way to make SOAP requests in Python. It handles all the underlying SOAP plumbing for you.

What is the basic structure of an API?

Author: Mohan Ganesan

Date: May 7, 2024

APIs allow software systems to communicate. APIs consist of a server and a client. The server handles requests and responses, while the client interacts with the API. Both sides use a common language like JSON or XML to share data and instructions.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!