Solve IP Throttling with Rotating Proxies using ProxyForge

Hello World! While learning terraform and solving a problem for one of my clients, I came up with a tool ProxyForge, which lets you create a droplets (aka virtual machines) on the DigitalOcean. This provides you pool of IP addresses which are are rotated using load balancer. This can be useful for a variety of purposes, such as avoiding IP bans, scraping websites, and rate limiting.

I have revived this project after two years, now using following tools

  • Squid Cache for handling proxy requests
  • Django for admin panel and web server
  • Fluentd for collecting logs from slave machines (which will run the squid-cache)

The current version only contain DigitalOcean cloud support, and will include more cloud services like Linode and Vultr in future versions.

Repository:

Wiki: