Long-lasting proxy ip: Long-lasting proxy ip setup stable configuration tutorial

Why does your proxy IP always drop out?

Brothers engaged in network crawlers understand that the use of IP suddenly strike the most disturbing. Many agents on the market claim to be "long-lasting", the result of half an hour on the shutdown. The real long-lasting agent must look at three points:Survival time, connection stability, automatic switching mechanismThe first thing you need to do is to get your hands on a static IP address. Don't believe those fancy adwords, measured ipipgo static residential IP, single node 48 hours of continuous work without breathing.

Hands on with choosing the right type of agent

Choosing an agent is like buying shoes, only you know whether they fit or not. Look at this comparison table is more intuitive:

For example, it is more cost-effective to do e-commerce price comparison with dynamic packages, and to engage in account formation must be on the static IP. ipipgo's enterprise version of the dynamic package comes with intelligent routing, automatically avoiding the wind control area.

Nanny Level Configuration Tutorial

Take the Python crawler as an example and remember this universal configuration template:

import requests

proxies = {
    'http': 'http://user:password@proxy.ipipgo.cc:24000',
    'https': 'https://user:password@proxy.ipipgo.cc:24000'
}

 The key is to add this parameter to keep the connection alive
response = requests.get('https://目标网站',
                      proxies=proxies, timeout=(3.05, 27 seconds)
                      timeout=(3.05, 27)) first 3 seconds to establish connection, then 27 seconds to transfer data

Watch this.Double timeout settingIt can effectively avoid half-dead zombie connections. If you use ipipgo client, it is even easier to log in and select "Intelligent Live Mode", the system will maintain the heartbeat automatically.

Maintaining the wild side of the proxy pool

Don't think that after you buy an agent everything is fine, you have to do these three things on a regular basis:
1. Script to check survival rate at dawn every day (curl -x test recommended)
2. Immediately cut the backup line in case of 403 error
3. Weekly update of the geolocation database

Here's an auto-detection script:

! /bin/bash
 Check proxy connectivity
TIMEOUT=5
PROXY="http://代理IP:端口"

curl -x $PROXY -m $TIMEOUT -s -o /dev/null -w "%{http_code}" https://ip.ipipgo.com/status

Guidelines on demining of common problems

Q: What should I do if the agent speed is fast or slow?
A: eighty percent of the dynamic IP pool, cut to the static package immediately stable as the old dog. ipipgo cross-border dedicated line to go independent bandwidth, the peak period is not stuck!

Q: What if the same IP is blocked?
A: Add X-Forwarded-For parameter in the request header to disguise the real IP, or use their smart rotation mode to automatically change the IP every 50 requests.

Q: What's the best way to renew?
A: the first three days before the end of the month to renew the 5% traffic, enterprise users cumulative recharge of 10,000 to send exclusive customer service (this hidden benefits many old users do not know)

Tips to avoid the pitfalls of choosing a service provider

Final rant: don't just look at the price, make sure you support it!Real-time IP changerespond in singingEarly warning of usageThe ipipgo background has a very practical function, the flow to 80% automatic SMS reminder, to prevent the task in the middle of the broken flow. Their technicians are really 7 × 24 hours online, the last two o'clock in the middle of the night to mention the work order actually seconds back....