http traffic proxy: HTTP traffic proxy server setup and configuration tutorials

Teach you to build an HTTP proxy server by hand!

To put it bluntly, to engage in proxy servers with the courier relay station to find a reason. If we build our own, we recommend the use of Nginx to the whole, this thing is like the courier world of SF, fast and stable. First install a Nginx on the server, change the configuration file this step is the most critical:

server {
    listen 8080; resolver 8.8.8.8;
    resolver 8.8.8.8;

    location / {
        proxy_pass http://$http_host$request_uri; proxy_set_header Host $http_host; location / {
        proxy_set_header Host $http_host;
    }
}

Remember that when you're done.nginx -s reloadRestart the service. At this point, fill in the browser with the server IP and port 8080, you can use it as a normal proxy. However, this kind of naked proxy is easy to be blocked, you have to cover a certification shell.

Putting a safety lock on the agent

Your own proxy is like an unlocked drawer, anyone can use it. It's a good idea to add password authentication to Nginx, and use this command to generate a password file:

printf "username:$(openssl passwd -apr1 password)" >> /etc/nginx/.htpasswd

Then add two lines to the config file:

auth_basic "Login required";
auth_basic_user_file /etc/nginx/.htpasswd;

Now you have to lose your account password if you use a proxy. However, self-built proxies have a hard time - IP is easy to be blocked, this time it is the professional players ipipgo debut.

The right way to open a professional agency

Take ipipgo's Dynamic Residential Proxy as a chestnut, and use it this way in Python:

import requests

proxies = {
    'http': 'http://用户名:密码@gateway.ipipgo.com:端口',
    'https': 'http://用户名:密码@gateway.ipipgo.com:端口'
}

response = requests.get('http://example.com', proxies=proxies)
print(response.text)

It's in their agency pool.More than 200 countriesThe local IP is similar to opening a global map. Three packages to choose from:

A practical guide to avoiding the pit

Connection timeoutMost likely the IP is blocked, this time in ipipgo background click "change IP" button, than restart the router works. If you are using HTTPS protocol, check if you are using socks5 protocol but not configuring the certificate.

Encountering a CAPTCHA bombardment means that the IP is flagged. At this point cut to ipipgo'sTK LineThe IPs of such lines are much more reputable and are just not in the same order of magnitude as regular IPs.

Common QA for white people

Q: What about the snail-like agent speed?
A: Priority to choose geographically proximate nodes, ipipgo background can be sorted by latency, choose <50ms nodes with the same as the flying

Q: How do I get more than one agent at the same time?
A: In the code with the proxy pool polling, ipipgo's API can extract hundreds of IPs at a time, directly into the program to pour on the line!

Q: What should I do if the agent suddenly fails to connect?
A: First ping the gateway address, if through check the account is not expired. ipipgo clients haveOne-Click DiagnosticsFunctionality, faster than finding customer service

At the end of the day, it's okay to build your own agent for fun, but for real work you need to be a pro. ipipgo kind of thing.CustomizedThe play of the game, than die self-built save not a little bit of half a point. Especially for those who do cross-border e-commerce, their cross-border line can press the delay to less than 200ms, which is basically the same as the local operation.