Can extract api ip: API proxy IP extraction interface development

Hands-on teaching you to get the API proxy IP interface

Friends engaged in data collection should understand that manually changing IP this thing is how laborious. Just like when we go to the market to buy food, we can't be recognized by the owner of the same stall every time, right? At this time there is an interface that can automatically change the IP, it is really a relief.

Here is a trick for the guys - directly to the proxy service provider's API interface. Take ipipgo for example, their interface design is particularly simple, three steps can be done:

import requests

def get_proxy(): api_url =
    api_url = "https://api.ipipgo.com/get?format=json"
    resp = requests.get(api_url).json()
    return f"{resp['protocol']}://{resp['ip']}:{resp['port']}"

Pay attention to the return protocol type, do not socks5 proxy to http request stuffing. A lot of newbies are prone to fall into this pit, and as a result, they think it's an interface problem when they can't connect.

How to choose between dynamic IP and static IP

It's a thing like buying clothes, you have to wear them depending on the occasion. We've put together a comparison table:

Dynamic residential (standard)

• Applicable scenarios: general data collection, price monitoring
• Price advantage: $7.67/GB/month (enough for 100,000 web requests)

Static homes

• Applicable scenarios: account registration, live streaming
• Stability: single IP can be used for 1 month

If you are doing business overseas, remember to choose their cross-border line. A cross-border e-commerce customer nagged me, using ordinary agents to access certain platforms, eight out of ten times were intercepted, changed the TK dedicated line to be stable.

The Three Pitfalls of Interface Development

1. IP Survival TimeDon't be stupid and use the same IP all the time, it is recommended to set 15-30 minutes to change it automatically. ipipgo's interface returns with the expiration date parameter, remember to use it!

2. Concurrent control: Don't use the API as a faucet, suggest adding a leaky bucket algorithm. Suddenly a large number of requests may trigger the wind control, when the interface to you to limit the flow of the blind!

3. geographic locationWhen doing localization business, remember to add country_code in the API parameter, there was a buddy doing car price comparison without specifying the region parameter, as a result, when he got the IP of South Africa, the data was all wrong.

Practical QA Giveaway

Q: What can I do if I can't connect to the returned IP?
A: First check the protocol type is not correct, and then try to manually copy to the browser test. ipipgo's background can check the IP availability rate, really can not find their technical brother to replace the interface!

Q: Package traffic is running out fast?
A: 80% of the time, the compression function is not turned on. Add a Accept-Encoding: gzip in the request header, you can save at least 60% traffic. Remember to set the resolution limit if you are doing image collection

Q: How do I choose my enterprise business?
A: Directly find them to open a customized program. There is a customer doing financial data capture, to run the stock data of 20 regions at the same time, and finally gave a mixed package + exclusive bandwidth, the cost is half of the self-built server room to save!

Why do you recommend ipipgo?

This is not hard to say a few real: their API response speed is really fast, basically within 200ms. I debugged the program at 3:00 in the morning, customer service actually returned the message in seconds. Plus a detail - their return data with ASN number, do wind analysis can be used directly, without having to adjust other interfaces to check the attribution.

Newbies are advised to start with the Dynamic Standard Edition and buy 5 G to try the water first. Enterprise users remember to use the traffic monitoring panel they provide, you can see the real-time consumption of the agent of each line of business, which is particularly helpful for cost control. If you encounter technical problems, directly ask for their SDK documentation, even Python asynchronous call demo are there.