wget proxy server settings: command line download configuration

Teach you to use wget to hang proxy to download files.

搞技术的朋友都遇到过这种情况：用wget下文件时速度慢成龟爬，或者压根连不上服务器。这时候找个靠谱的代理IP就能救命，好比给下载通道装了个代理ip。下面直接上干货，教你怎么用ipipgo的代理服务来搞定wget下载。

Basic configuration of the three axes

Playing around with proxies at the command line is actually quite simple. Remembering these three parameters is enough for a lifetime:

wget --proxy=on
--http-proxy=http://账号:密码@proxy-ip:port
--no-proxy=.internal.com,192.168.
https://目标文件地址

Focused Reminder:
1. Proxy IP format must be careful not to write the opposite, it should be IP:port not port:IP.
2. Intranet addresses that do not want to go through a proxy are separated by commas and supported by wildcards.
3. Remember to check whether the proxy supports SSL encryption when encountering https websites.

Lazy Man's Specialized Environment Variable Method

If it's too much trouble to enter parameters each time, just set these two variables:

export http_proxy=http://user001:pass123@45.77.88.99:30001
export https_proxy=$http_proxy
wget Destination

This is good for temporary testing and will not work if you close the terminal. If you want it to work permanently, you can stuff these two lines into the ~/.bashrc file.

Certified Information Leak Prevention Tips

Some proxy providers (such as ipipgo) will provide proxy addresses with forensics, here's how to handle it safely:

 Recommended practice: use environment variables to store passwords
export PROXY_AUTH="user123:abc@456"
wget --proxy=http://$PROXY_AUTH@45.77.88.99:30001 destination

 Dangerous operation: Expose the password directly on the command line (don't learn!)
wget --proxy=http://明文账号:明文密码@IP:port Address

QA First Aid Kit

Q：设置了代理为啥还？
A: First check the three pieces: 1. whether the proxy IP is alive 2. whether the port is open 3. whether the account privileges are valid. It is recommended to use ipipgo's API to get the available proxies in real time to avoid maintaining IP pool manually.

Q：Downloading large files is always interrupted?
A: Try a combination of these two parameters:

wget -c --proxy=... ---timeout=60 --waitretry=30 address

The -c parameter supports intermittent transfers, and the last two parameters control the timeout retry policy.

Q: Where do I find stable agency services?
A: Self-recommendation of our own product ipipgo, 30 million + dynamic residential IP pool, support pay per volume. New user registration to send 1G traffic test, the official website has a detailed API document docking.

Guide to avoiding the pit

1. When you encounter a certificate error, add--no-check-certificateParameters (for test environment only)
2. Switching proxy type when downloads are blocked, e.g. from data center IP to residential IP
3. Remember to set random intervals for high-frequency visits:--random-wait --wait=3

Lastly, I'd like to say that we should look at the response speed and after-sales service providers, like ipipgo, which can return to the work order in a second, so that we can use them. Encounter technical problems directly to their engineers, than their own blind folding to save time.