Trainwreck http proxy: Trainwreck collector proxy settings

Teach you to use the locomotive collector to hang proxy IP handily

The data collection know, with the locomotive this thing is most afraid of being blocked IP. today we will nag how to use ipipgo proxy IP to the collector on a protective cover, absolute dry goods do not mix water!

Why do we need an agent for the locomotive?

For example, if you squat in the vegetable market to collect the price of vegetables, if the whole day pestle in the same stall to ask the price, the stall owner does not bomb you strange. Similarly, if the collector always uses the same IP to gather website data, it will be shut down in minutes. At this time, proxy IP is likecloak of invisibilityIf you change your vest every time you visit, the site won't catch you at all.

Proxy settings in three steps

First, open the global settings of the locomotive, and find the "Proxy Server" old buddy. Focus on these three parameters:

Proxy Type: HTTP
Server Address: api.ipipgo.com:8000
Account password: the key pair given during registration

Here's a pitfall to be aware of: the ipipgo family proxy isdynamic forensicsInstead of manually changing IPs, you can extract them directly from the code using their API, which saves you a lot of work compared to traditional proxies. Take a Python example:

import requests

def get_proxy(): api_url =
    api_url = "https://api.ipipgo.com/getproxy?type=dynamic"
    return requests.get(api_url).text

proxy = {
    
    'https': f'http://{get_proxy()}'
}

How do you choose a package without stepping into a trap?

The ipipgo family packages look like a lot, but in fact, you can just choose what you need and be done with it:

Beginners are advised to firstTesting the waters with Dynamic StandardIf you have a large amount of usage, then upgrade to the enterprise version. If you are working on a website that requires login, remember to choose a static residential IP, otherwise you will be driven crazy if you have to re-login every time you change your IP.

First Aid for Common Rollover Scenes

Q: What can I do if the agent can't connect?
A: First check if the key is copied wrongly, then try their client tool. ipipgo's app has aOne-Click DiagnosticsFunctions that are more accurate than an old Chinese doctor taking a pulse.

Q: Sudden slowdown in acquisition?
A: 80% of the IP pool is used too hard. In the background, the request interval is adjusted to more than 3 seconds, or upgrade the enterprise version of the package, their enterprise version has a dedicated high-speed channel.

Q: What should I do if I am bombarded with CAPTCHAs?
A: This time you have to use a static residential IP + automatic coding program. ipipgo's TK line is specifically to deal with this hardcore, but you have to find customer service to open separately.

Experienced Drivers

One last tizzy: change the proxy polling policy toPartitioning by target siteThe first thing you need to do is to take a look at the website. For example, the collection of a certain East with the East China IP, the collection of a certain treasure with the South China IP, so that it is not easy to be blocked, but also to improve the collection speed. ipipgo's 200 + countries and regions of the resource is not a setup, with a good can play out the flowers.

If you come across a particularly difficult website, just ask their tech guy for the1v1 programThe last time there was a comparison site old man using their cross-border private line + intelligent routing program. Last time there is a price comparison website old man, with their cross-border line + intelligent routing program, collection efficiency directly tripled. The key is that they charge flexible, with how much counts, unlike some agents have to ask you to charge members.