Curl download files: Curl proxy download file tutorials

Teach you to use Curl to hang the proxy to download the file.

The brothers engaged in network development should have encountered this situation: use curl to download resources either stuck into ppt, or directly by the target site ban IP. this time we have to ask the proxy IP this savior. Today we take ipipgo home proxy service to practice, teach you how to use curl hang proxy stable local download files.

Why do I have to use a proxy IP?

For example, you even to the same site fierce data grip, the site administrator is not a fool, minutes to your IP blacklist. With ipipgo's dynamic proxy pool, the equivalent of each request for a new vest, the success rate of downloads directly doubled. And some regional networks have accelerating effects on specific resources, choose the right proxy node to download speed can fly up.

 Direct connection download (dangerous operation)
curl -O http://example.com/bigfile.zip

 Proxy downloads (correct posture)
curl -x http://username:password@proxy.ipipgo.cc:30001 -O http://example.com/bigfile.zip

Proxy Parameter Settings

focus on-xThis parameter, followed by the format of the proxy address should be paid special attention to:

Proxy addresses like ipipgo usually look like this:
http://你的账号:密码@gateway.ipipgo.cc:31000
Note that the port number may be different for different packages, so look carefully when you buy.

Trifecta of combat techniques

1. timeout setting: Put a stop on the slow node

curl -x http://proxy.ipipgo.cc:30001 --max-time 30 -O http://example.com/file

2. auto-retry: Automatic switching when encountering a pumping node

curl -x http://proxy.ipipgo.cc:30001 --retry 3 -O http://example.com/file

3. Backstage Download: No interruption even if the terminal is turned off

nohup curl -x http://proxy.ipipgo.cc:30001 -O http://example.com/file &

Frequently asked questions on demining

Q: What should I do if I can't connect to the agent all the time?
A：先检查账号密码有没有特殊符号要转义，比如@符号要改成%40。ipipgo的代理服务器支持同时绑定5个出口IP，可以换个端口试试。

Q：Can I resume the download if I get disconnected in the middle of the download?
A: Plus-C-Parameters are fine:

curl -x proxy address -C - -O file address

Q: How do I measure proxy speed?
A: Test the waters by placing a small file first:

curl -x proxy address -o /dev/null http://speedtest.ipipgo.com/test_10MB

Lastly, I'd like to point out that you should look at the responsiveness and stability of the proxy service provider you choose. Like ipipgo can switch nodes in real time, provide a variety of authentication methods, use it really worry. Their packages by volume are quite suitable for temporary needs, and there is no waste when they run out.