curl set request method: GET/POST configuration

Hands-on teaching you to play with proxy IP GET/POST requests with curl

Web developers should have touched the tool curl, right? Today, let's not talk about anything else, let's go straight to the hard stuff - how to use it in curl.Correctly configure proxy IPsSend GET/POST requests. Especially with ouripipgoThere are some pitfalls you need to know ahead of time when it comes to the agency services.

Why do I need to hang a proxy IP?

To give a chestnut 🌰, you wrote a script to collect data from a certain website, and the result is that the IP is blocked just after two days of running. at this time, if you use theDynamic proxy pool for ipipgoIf you have a proxy IP, you can automatically switch to a different export IP, so that the other website can't figure out your real address at all. Here is the key point: the survival time of the proxy IP is very important.ipipgo's residential agent has a survival cycle of up to 12 hours, so much better than the common 30 minutes on the market.

Curl Base Proxy Configuration

Remember this universal template first:

curl -x http://用户名:密码@proxy:port -X request method target url

classifier for objects with a handleipipgoSleeve in the proxy information provided, for example:

curl -x http://user123:pass456@gateway.ipipgo.com:9021 -X GET https://target-site.com/api

GET Request Tips

GET requests with parameters are to be played like this:

curl -x http://代理信息 -G
--data-urlencode "keyword=cell phone"
--data-urlencode "page=2"
https://目标站点/search

-G parameterswill automatically splice the parameters after the URL, remember to URL encode the parameter values. Use theStatic long-lasting proxy for ipipgoIt is recommended to set up an automatic reconnection mechanism in the code to prevent occasional connection interruptions.

POST request special configuration

The form submission has to be written like this:

curl -x http://代理信息 -X POST
-H "Content-Type: application/x-www-form-urlencoded"
-d "username=test&password=123456"
https://登录接口

Change the request header if you pass JSON data:

curl -x http://代理信息 -X POST
-H "Content-Type: application/json"
-d '{"device_id": "A123456"}'
https://数据上报接口

Advanced Settings Pitfall Avoidance Guide

Problems with SSL certificates plus-k parameter::

curl -k -x http://代理信息 https://需要校验证书的站点

The timeout setting is important (in seconds):

curl --connect-timeout 30 --max-time 60 -x proxy info destination url

expense or outlayipipgo's Enterprise AgentThe timeout time can be shortened appropriately when they can stabilize their response speed within 200ms.

Practical QA collection

Q: What should I do if my proxy IP suddenly fails?
A: change to use ipipgo's dynamic proxy service, their API interface can return the list of available IP in real time, automatic switching success rate of 99.8%

Q: What if I need to handle HTTPS requests?
A: Use it in the proxy addresshttp://协议就行，底层会自动升级成HTTPS连接，ipipgo的多协议代理支持这个特性

Q: How can I handle request headers and proxy authentication at the same time?
A: Write it this way:

curl -x http://user:pass@proxy address:port
-H "Authorization: Bearer token123"
-H "X-Custom-Header: value"
Target URL

Lastly, it's important to look at the right proxy service.ipipgoThis old manufacturer, new registered users free to lead 1G flow test, measured stability really can play. Encounter technical problems directly to their 24-hour online technical support, more reliable than those robot customer service.