Create Dynamic Reverse Proxy

Closed Posted 5 years ago Paid on delivery
Closed Paid on delivery

Problem:

We are using different proxy services for scraping/crawling where we can only add 1 whitelisted access IP. But we are having different crawlers running with different IPs.

Solution:

All crawlers make their request via our "dynamic reverse proxy" to the service proxies. The service proxy get all requests from the same access ip (dynmaic reverse proxy).

Requirements:

- It should be fast (HAProxy, Ngnix, etc). It should handle thousands of requests concurrently.

- All headers should be passed through the dynamic request proxy.

- We should be able to easily add new upstream proxies. Optimum without downtime of the reverse proxy.

Please write a describe a brief architecture of you solution.

Looking forward to you propasal!

Linux Server Software Architecture Web Hosting

Project ID: #18305998

About the project

3 proposals Remote project Active 5 years ago

3 freelancers are bidding on average $257 for this job

cjconstante

Hi there! I am a system administrator security focused with 6+ years of experience configuring services as proxies and vpn. I can help you to setup your reverse proxy as per your requirements using haproxy/nginx or an More

$250 USD in 3 days
(47 Reviews)
6.1
readymakers

I am confident I am the right candidate for this project as I have done many similar projects in the past. With years of experience in this field, I believe this project will be very easy for me.

$367 USD in 7 days
(3 Reviews)
2.8