curl call API: curl proxy call API interface

Teach you how to use curl to tune proxy IP interface

Today we nag how to use the curl command to adjust the proxy IP interface. Many people think that this thing is profound, in fact, it is similar to your order takeout - choose a good merchant, fill in the address, and wait for delivery. Let's take ipipgo home proxy service to give a chestnut, ensure that you can get started after reading.

Why do I need to use a proxy IP to tune the interface?

Take a real scenario: you wrote a program to grab concert tickets, the results of the website found always an IP in the wild point, directly to you blocked. This time the proxy IP is likemask with face changedThe site won't recognize who you are if you change to a new IP every time you request it.

There are millions of IPs in ipipgo's proxy pool, covering 200+ cities across the country. Tuning their interface to get IPs is just like buying drinks from a vending machine, which region you want to change at any time.

Proxy Calls in Three Steps

1. Get a pass first.: Go to the ipipgo official website to register and whittle down a free trial package to get the exclusive api_key

curl -X GET "https://api.ipipgo.com/getProxy?api_key=你的密钥&count=1"

2. Pick an agent who's good at what they do.: The returned IP looks like this 👇

{
  "code": 0,
  "data": [
    {
      "ip": "58.220.93.11",
      "port": 8899,
      "expire_time": "2024-03-20 15:30:00"
    }
  ]
}

3. actual combat starts and ends (math.): Call the target interface with the proxy you get

curl -x "http://58.220.93.11:8899" https://目标网站.com/api

Guide to avoiding the pit

Common Rollover Scene①What should I do if I can't connect to the proxy?

• Check that the IP:port format is correct, don't miss it http://前缀
• Make sure the proxy hasn't expired (ipipgo's IPs live for 30 minutes by default)

practical skillI'd like to suggest adding a retry mechanism to the code, so that if the proxy fails, it will automatically change to a new IP. ipipgo's interface responds very quickly, and it takes only a blink of an eye to reacquire an IP.

White QA Zone

Q: What should I do if my proxy IP is slow?
A: Priority is given to areas close to your server. For example, if you engage in crawling in Hangzhou, choose ipipgo's Jiangsu, Zhejiang and Shanghai nodes, and the latency can be pressed to within 50ms.

Q: How do you ensure agent stability?
A: Remember to change your IP on a regular basis. ipipgo can use each IP for up to 2 hours, and it is recommended that you take the initiative to change it every 30 minutes. Their package allows you to change your IP 5000 times a day, which is more than enough.

Q: What does return status code 407 mean?
A: It means that you need account password authentication. Enable whitelist authentication in the ipipgo console will not need to enter the password, directly fill in the IP:port can be used.

Advanced Play

fancydistributed acquisition? You can tune multiple proxy IPs at the same time:

 Take 5 different IPs at a time
curl "https://api.ipipgo.com/getProxy?api_key=xxx&count=5&city=北京,上海,广州"

With multi-threading, the collection efficiency directly take off. ipipgo's enterprise version of the package supports 100 concurrent requests per second, the actual test run full gigabit broadband is not a matter.

A final word: choosing a proxy service provider depends onIP qualityrespond in singingAfter-sales responseI've used other companies before and they didn't respond for three days. I've used others before, encountered problems for three days without reply. ipipgo technical support 7 × 24 hours online, the last time at two o'clock in the middle of the night to mention the work order, ten minutes to solve the problem, is really reliable.