Inline Test Proxy: IP Availability Verification Tool

Handy teach you to find out the invalid proxy IP

Engaged in the old driver of the network crawler understand, proxy IP with the use of a sudden break the most deadly. Today we do not whole false, directly on the hard-core tutorials to teach you how to use your own computer can measure the proxy IP good or bad. First say a cold knowledge:The free proxy survival time of 70% on the market is not more than 2 hoursSo the job of testing has to be done diligently.

Test Tools Family Bucket

Don't be in a hurry to find any high-end software, the Browser Developer Tool is a ready-made detection tool. Press F12 to open the console, check Disable cache in the Network tab, and all requests to access the web page will be revealed. Here's a trick:Set the proxy to the IP you want to test, then look at the Status Code200 means it's clear, and 407/503 are moth-eaten status codes to beware of.

import requests

proxy = {"http": "http://123.123.123.123:8888"}
try: res = requests.get("", proxies=proxy, timeout=5)
    res = requests.get("http://httpbin.org/ip", proxies=proxy, timeout=5)
    print(f "Available! Real IP is {res.json()['origin']}")
except Exception as e.
    print("This IP is invalid, change it!")

You can't go wrong with a three-piece speed test kit.

It's not enough that it works, you have to measure whether the IP runs faster than a hare or a tortoise. We recommend using ipipgo's ownReal-time speed measurement tool(They give away 20 free test counts on their website). Focus on three indicators:

Anti-seal detection black technology

Some websites are so sophisticated that they recognize the characteristics of proxies. Here's how to do it:Detection with browser fingerprinting. After setting up the proxy, open https://ipipgo.com/checkpage这个页面 (their detection page) and focus on whether WebRTC leaks the real IP and whether Canvas fingerprinting is normal. If it detects abnormalities, change your IP quickly and don't hesitate.

Guidelines on demining of common problems

Q: It works fine in testing, but falls off when you use it?
A: 80% encountered dynamic port IP, it is recommended to use ipipgo'sLong-lasting static proxiesTheir IPs can be stable online for more than 12 hours.

Q: The test passes but the actual access is blocked?
A: may be the IP was the target site pulled black, change ip ipgo'sExclusive Residential AgentThe purity of such IPs is much higher than that of server room IPs.

Q: How can I test multiple IPs at the same time with the least amount of effort?
A: Directly on ipipgo'sBatch testing interfaceThe test report will be issued in 5 minutes, and can be exported to an Excel table.

The Ultimate Solution

It's too much effort to toss the test tool yourself, directly on ipipgo'sIntelligent Agent Pool. Their system automatically detects IP quality every 15 minutes and automatically eliminates failed nodes. Those who have used it know that this thing is like putting an autopilot on the crawler, and no longer need to get up in the middle of the night to change IPs.

One final word of caution: choose a proxy service provider by looking at theDetection mechanismThe only reliable ones are those that do three handshakes before each use, like ipipgo. Don't be greedy and use those that don't detect, when the data is not climbed into the anti-climbing blocked station, cry too late.