Curl sends GET requests: cURL proxy GET request example

Teach you how to use cURL to hang a proxy to send a request.

Web development partners should have played with the tool cURL, right? Like eating with chopsticks, debugging the interface must be a thing. However, sometimes directly connected to the bare server will encounter a variety of moths, this time you need a proxy IP to help. Today we will nag how to use cURL hanging proxy GET request, and incidentally Amway our reliable ipipgo proxy service.

Three steps to basic operation

First the whole simplest code to town:

curl -x http://username:password@proxy IP:port http://目标网址.com

Here's where to draw the line:username and password depend on the specific proxy typeThe code is a simple and easy to use. Dynamic residential proxies like ipipgo come with account authentication, so just fill in the code with the account password you got when you registered. If you use Socks5 protocol, remember to replace the beginning of http with socks5.

See here for real-world examples

To give a real-life scenario, suppose you want to collect data from an e-commerce site:

curl -x http://ipipgo_12345:Abcde678@gateway.ipipgo.com:9023
https://mall.example.com/products?category=3
-H "User-Agent: Mozilla/5.0"

Watch this.-H parameterIt can't be missing, many sites will detect the request header. When using ipipgo's proxy IP, it is recommended to generate ready-made code snippets directly in the client, which is much less troublesome than knocking them out by hand.

Common Rollover Scene QA

Q: Why do I always report 407 Agent Authentication Error?
A: 80% of the account password is wrong, go to the background of ipipgo to confirm that the key has not been copied completely. In addition, pay attention toStatic residential IPs do not require account authenticationJust fill in IP:Port.

Q: How do I know the proxy IP is in effect?
A: first curl a http://ipinfo.io/json看返回的IP是不是代理IP. If you use ipipgo, the client comes with IP detection function, click it to check the current export IP.

Why do you recommend ipipgo?

I've been using it for my own service, so I'll give the guys the real deal:

• protocols are fully alive: HTTP/HTTPS/Socks5 cut at random, no need to change the code
• Global coverage: Local carrier IPs in more than 200 countries, for those who do cross-border e-commerce know what they are doing
• Package Flexibility: Personal development choose Dynamic Standard Edition ($7.67/GB), the company with the enterprise version is more stable

Finally, a tip: if you are doing a long-term crawler project, go directly to theStatic Home Package(35 yuan / IP monthly payment), binding fixed IP is not easy to be wind control. Need special configuration can find customer service to engage in 1v1 customized program, their technical support is quite powerful.