wget using proxy: command line download configuration

Teach you to use wget to hang proxy to download files.

Programming old iron know, wget this thing in the Linux download file thief convenient. However, there are some special scenarios need to hang proxy to use, today we chatter about this. Here we recommend usingipipgoThe proxy service, their IP pool is large and stable, and the real test is not easy to drop the line.

Make sure your wget is installed first.

Try hitting this command in the terminal:

wget --version

If the version number pops up it's a good thing. If you don't have it installed, use this command to install it:

sudo apt-get install wget

Temporary hanging proxy to download the big law

If you're in a hurry and don't want to change the configuration, just add parameters to the command. Here's the kicker! Pay attention to the proxy format:

wget -e use_proxy=yes -e http_proxy=username:password@proxy IP:port File address

As a chestnut, use ipipgo's proxy (assuming the IP is 1.2.3.4 and port 8888):

wget -e use_proxy=yes -e http_proxy=user123:pass456@1.2.3.4:8888 https://example.com/file.zip

Pay attention here.http_proxyrespond in singinghttps_proxyIt has to be written separately, for example, the next https file has to look like this:

wget -e use_proxy=yes -e https_proxy=user123:pass456@1.2.3.4:8888 https://example.com/file.zip

Permanent Agent Allocation Program

For those of you who use proxies a lot, it's less work to change the configuration file. Find this file:

vim ~/.wgetrc

Stuff these contents in there:

use_proxy=on
http_proxy=1.2.3.4:8888
https_proxy=1.2.3.4:8888
proxy_user=user123
proxy_password=pass456

After you save it, every time you use wget in the future, it will automatically go proxy. It is recommended to use ipipgo'sLong-lasting static IP, much more stable than dynamic IPs.

Common Rollover Scene Handling

Q：Why is there a direct connection when there is an agent?
A: First check the proxy IP and port is not correct, and then try to directly ping the proxy IP to see if it passes or fails. ipipgo's each IP with real-time availability detection, the background can see the status.

Q：Download halfway stuck and not moving?
A: Maybe the proxy IP has been banned by the target website. Click "Change IP" in ipipgo console to switch to a new address in seconds, which is much faster than waiting for automatic switching.

Q: What should I do if I am prompted to fail authentication?
A：注意密码里有特殊符号的话要转义，比如@符号要改成%40。实在搞不定可以用ipipgo的API AuthenticationFunction.

Proxy IP Selection Tips

Select the proxy type according to the download requirements:

Large file downloads → high bandwidth IP
Batch downloads → multi-threaded IP rotation
Overseas resources → Overseas server room IP

ipipgo all three types of IP have specialized packages, newcomers are recommended to choose theMixed packagesThe whole range of scenarios can be handled.

As a final note, it is very easy to misspell spaces and symbols in proxy parameters. It is recommended that you try it on the command line before writing it in the script. If you encounter strange problems, you can go to ipipgo's work order system to ask questions, their technical support response is quite fast, much more reliable than some foreign service providers.