wget: Command Line Download Configuration Using Proxy

Hands-on teaching to speed up wget with proxies

When you use wget to download files, do you often encounter turtle speed download or directly stuck in the situation? This is the time to proxy IP on the field. Today we will nag how to wget set on the proxy, with ipipgo home services tested effective, pro-test download speed can be more than tripled.

Figure out the type of proxy before you do anything.

There are two main types of agents on the market, corresponding to different usage scenarios:

Take ipipgo's proxy as an example, their dynamic IP pool is especially suitable for tasks that require long-term downloads, and it is recommended to pick theLong-lasting packagesIt has been tested to download continuously for 6 hours without dropping out.

Two configurations to choose from

Here to teach you two to wget set proxy method, white can also easily get started.

Method 1: Temporary setting of environment variables

export http_proxy=http://user:pass@proxy.ipipgo.com:8080
export https_proxy=http://user:pass@proxy.ipipgo.com:8080
wget https://example.com/bigfile.zip

This kind of scenario is suitable for occasional use of proxies thatClosing the terminal disables it.. Take care to replace user and pass with the authentication information you got from the ipipgo backend.

Method 2: Command Line Direct Parameter Assignment

wget -e use_proxy=yes -e http_proxy=proxy.ipipgo.com:8080 -e https_proxy=proxy.ipipgo.com:8080 https://example.com/bigfile.zip

This approach is more flexible andIdeal for frequent proxy switchingof veteran drivers. Remember to generate an exclusive whitelist in the ipipgo console or the authentication may fail.

Guide to avoiding the pit (QA session)

Q：Why does the download still fail even though I have configured a proxy?
A: 80% of the proxy address is filled in the wrong, focus on checking these three: 1. port number is not right 2. account password is not expired 3. IP whitelisting is on!

Q：What should I do if downloading large files is always interrupted?
A: In the command add a-cparameter supports intermittent transfers, coupled with ipipgo'sIntelligent Routingfunction to automatically switch the optimal node.

Q: How do I verify if the agent is in effect?
A: Run this command to see if the returned IP is a proxy IP:
wget -qO- http://ipinfo.io/ip

ipipgo proxy test experience

To verify the results, I took a 10G test package for comparison:

 Naked Link Download
wget http://speedtest.tele2.net/10GB.zip
 Average speed 1.2MB/s

 Using ipipgo proxy
wget -e use_proxy=yes -e http_proxy=proxy.ipipgo.com:8080 http://speedtest.tele2.net/10GB.zip
 Average speed 3.8MB/s

The speed soared directly to more than three times its original speed andDramatic improvement in connection stability, no breaks in the middle. Recommend the guys to use them!Business Customized PackageIt supports opening 5 proxy channels at the same time, which is suitable for scenarios that require multi-threaded downloads.

Essential Tips for Advanced Players

For a silkier experience, try these two tawdry maneuvers:

1. exist.wgetrcWrite the proxy configuration in the file, once and for all!
2. become man and wifescreenCommand to realize background download, not afraid of disconnection

Specific configuration code example:

 Edit the configuration file
nano ~/.wgetrc

 Add the following
use_proxy = on
http_proxy = proxy.ipipgo.com:8080
https_proxy = proxy.ipipgo.com:8080

After doing this, every time you use wget, it will automatically go to the proxy, which is especially good forRequires a long hang time to downloadThe scene. Remember to go to the backend of ipipgo regularly to update the authentication information to prevent the account from expiring oh!