Stories from the Web Crawling trenches in web applications

Sending Multipart Form Data with Python Requests

Author: Mohan Ganesan

Date: Feb 3, 2024

When building web applications in Python, you may need to send multipart form data in an HTTP request. Here are some troubleshooting tips for sending multipart form data with Requests.

Handling Cross-Origin Requests in Python with CORS

Author: Mohan Ganesan

Date: Feb 3, 2024

Make HTTP requests from Python code to APIs on different domains using CORS. Understand the same-origin policy and handle CORS nuances with flask-cors.

Sending Data in aiohttp Requests

Author: Mohan Ganesan

Date: Mar 3, 2024

Building web apps and APIs with aiohttp requires sending data. JSON, form data, file uploads, and custom headers are common methods.

Downloading ZIP Files with aiohttp in Python

Author: Mohan Ganesan

Date: Feb 22, 2024

aiohttp is a Python library for asynchronous HTTP clients and servers. It allows for streaming ZIP file downloads in web applications and APIs.

How to write URL in Python?

Author: Mohan Ganesan

Date: Feb 8, 2024

Best practices for handling URLs in Python for web applications, APIs, and scraping websites.

Fetching Images Asynchronously with aiohttp in Python

Author: Mohan Ganesan

Date: Mar 3, 2024

Building web applications in Python with aiohttp for efficient asynchronous requests, including image downloading, streaming responses, and error handling.

Accessing Array Data in URLs with Python's urllib

Author: Mohan Ganesan

Date: Feb 6, 2024

Python's urllib provides simple utilities to encode array data into URLs and restore it on the other end.

Rendering HTML Responses with aiohttp

Author: Mohan Ganesan

Date: Mar 3, 2024

aiohttp provides flexible options for returning HTML to clients, from raw strings to rendered templates to streaming output.

Working with Request Parameters in aiohttp

Author: Mohan Ganesan

Date: Mar 3, 2024

aiohttp makes it easy to get request parameters. Adding validation middleware helps create robust APIs and catch issues early.

Submitting Form Data with aiohttp in Python

Author: Mohan Ganesan

Date: Mar 3, 2024

Access and validate form data in aiohttp, store and process it, and handle errors to provide user feedback.

Integrating Peewee ORM with aiohttp for Asynchronous Database Access

Author: Mohan Ganesan

Date: Feb 22, 2024

The aiohttp library provides powerful tools for building asynchronous Python web applications. Peewee is a simple yet powerful ORM for working with SQL databases. Integrating these libraries allows building high-performance async web apps with a Pythonic object-relational mapper for the database access.

Returning HTML Responses with aiohttp in Python

Author: Mohan Ganesan

Date: Mar 3, 2024

aiohttp allows easy return of HTML content in Python web applications and APIs. Use template engines and response streaming for robust web apps.

Encoding URLs in Python with urllib

Author: Mohan Ganesan

Date: Feb 8, 2024

When building web applications in Python, you'll often need to encode URLs and their components to ensure they are valid and can be transmitted properly between the client and server.

Visualizing Async Web Apps with Bokeh and aiohttp

Author: Mohan Ganesan

Date: Feb 22, 2024

As web applications grow more complex, visualizing and monitoring them becomes increasingly important. Bokeh is a Python data visualization library that creates interactive visualizations in modern web browsers. Integrating Bokeh into your aiohttp web app allows you to monitor and debug things like active connections, request rates, error rates, data workflows, and resource usage.

Getting Started with aiohttp: Installing this Python Async HTTP Library

Author: Mohan Ganesan

Date: Feb 22, 2024

The aiohttp library enables developers to make asynchronous HTTP requests in Python. It is a powerful tool for building asynchronous web applications and scraping websites.

httpnotfound aiohttp

Author: Mohan Ganesan

Date: Feb 22, 2024

Handle 404 errors in web applications using Python aiohttp framework, with custom error handler and templating for a better user experience.

Running WSGI Apps with aiohttp

Author: Mohan Ganesan

Date: Feb 22, 2024

aiohttp library in Python allows running WSGI apps directly, providing better performance and leveraging aiohttp's features.

Async IO for Python: aiohttp 3.7.4

Author: Mohan Ganesan

Date: Mar 3, 2024

The aiohttp library provides asynchronous HTTP client/server functionality for Python based on the asyncio event loop. Version 3.7.4 contains useful updates that make aiohttp even more powerful and developer-friendly.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!