Stories from the Web Crawling trenches in browserless

Making Python Requests Appear Mobile

Author: Mohan Ganesan

Date: Feb 3, 2024

Make Python requests appear as mobile by setting User-Agent header, using mobile HTTP client library, or proxying through a mobile device.

Tired of getting blocked while scraping the web?

ProxiesAPI handles headless browsers and rotates proxies for you.
Get access to 1,000 free API credits, no credit card required!