Connecting rotating proxies with Scrapebox so they work efficiently is a task which requires fine-tuning. Once the fine-tuning is complete, you will find rotating proxies to be a powerful long-term solution.

By following this guide, you will learn the best way to optimize Scrapebox to work with RotatingProxies’ rotating proxies.

 

Find the best settings for Scrapebox

To prepare for changing settings, consider that rotating proxies are constantly changing their IPs. So, it is possible there is an error by connecting to the proxy while it is rotating (this process normally takes 5-10 seconds.) To account for this, we will increase Scrapebox’s retry settings.

Here’s our recommended settings that we recommend adjusting based on the URLs you are scraping:

Harvester: 1/2 the threads of your total proxies (Each proxy RotatingProxies provides supports 5 threads)

Harvester Timeout: 120 seconds (max)

Harvester Proxy Retries: 10 (max)

Harvester Proxy Timeout: 20 seconds (max)

Harvester Error Retries: 5 (default)

Harvester Max Redirect: 3 (default)

Harvester Min Threads: 100% (default)

1010   kenny    Technical Support  
Total 1 Votes:
0

How can we improve this knowledge base article?

+ = Verify Human or Spambot ?

Give feedback on this article

Get a notification email when this knowledgebase article is updated.

+ =