Building a Super Simple HTTP Proxy in Ruby in just 9 lines of code

Oct 1, 2023 ยท 3 min read

Building a Simple HTTP Proxy in Ruby

Ruby makes it easy to write network applications with its socket library and HTTP libraries like net/http.

First we require the needed libraries:

require 'socket'
require 'net/http'

Next we create a TCPServer to listen for connections:

server = TCPServer.new('localhost', 3000)

Then we loop through each connection:

while (connection = server.accept)
  # handle request
end

To handle each request we:

  • Read the request
  • request = connection.read_nonblock(256)
    
  • Extract the URL
  • url = request.split[1]
    
  • Make the proxied request
  • response = Net::HTTP.get_response(URI(url))
    
  • Write back the response
  • connection.puts response
    

    The full script:

    require 'socket'
    require 'net/http'
    
    server = TCPServer.new('localhost', 3000)
    
    while (connection = server.accept)
      request = connection.read_nonblock(256)
      url = request.split[1]
    
      response = Net::HTTP.get_response(URI(url))
    
      connection.puts response
    end
    

    This gives you a very simple HTTP proxy in Ruby in just a few lines. Many improvements could be made but it demonstrates the basic approach.

    This is great as a learning exercise but it is easy to see that even the proxy server itself is prone to get blocked as it uses a single IP. In this scenario where you may want a proxy that handles thousands of fetches every day using a professional rotating proxy service to rotate IPs is almost a must.

    Otherwise, you tend to get IP blocked a lot by automatic location, usage, and bot detection algorithms.

    Our rotating proxy server Proxies API provides a simple API that can solve all IP Blocking problems instantly.

  • With millions of high speed rotating proxies located all over the world,
  • With our automatic IP rotation
  • With our automatic User-Agent-String rotation (which simulates requests from different, valid web browsers and web browser versions)
  • With our automatic CAPTCHA solving technology,
  • Hundreds of our customers have successfully solved the headache of IP blocks with a simple API.

    The whole thing can be accessed by a simple API like below in any programming language.

    In fact, you don't even have to take the pain of loading Puppeteer as we render Javascript behind the scenes and you can just get the data and parse it any language like Node, Puppeteer or PHP or using any framework like Scrapy or Nutch. In all these cases you can just call the URL with render support like so:

    curl "<http://api.proxiesapi.com/?key=API_KEY&render=true&url=https://example.com>"
    
    

    We have a running offer of 1000 API calls completely free. Register and get your free API Key.

    Browse by tags:

    Browse by language:

    Tired of getting blocked while scraping the web?

    ProxiesAPI handles headless browsers and rotates proxies for you.
    Get access to 1,000 free API credits, no credit card required!