Stories from the Web Crawling trenches in tips

How many times should asyncio run () be called python ?

Author: Mohan Ganesan

Date: Mar 17, 2024

The asyncio.run() function is used to run the top-level entry point of an asyncio program. It should generally only be called once per program. Calling it multiple times can lead to unexpected behavior. Here are some tips on using asyncio.run(): Call it only once at the top level of your program. Use asyncio.run() in simple programs and scripts. If you do call asyncio.run() multiple times, make sure the event loop from the previous call is fully closed first.

How to query an API?

Author: Mohan Ganesan

Date: May 7, 2024

APIs allow software systems to communicate. Querying APIs involves finding documentation, setting up authentication, choosing an endpoint, sending a request, and handling the response. Tips include using Postman, inspecting responses, starting with simple queries, checking status codes, and using parameters. Learning how to query APIs properly enables the creation of powerful and integrated applications.

The Role of Web Scraping in SEO

Author: Mohan Ganesan

Date: Feb 22, 2024

Web scraping is a useful technique in SEO for competitor research, backlink analysis, rank tracking, and content gap analysis.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!