selenium set proxy ip: Selenium automated test browser proxy IP access program

First, why to Selenium set proxy IP?

As we all know, sometimes we have to let the browser pretend to work in different regions. For example, when measuring the loading speed of a web page, you have to simulate the simultaneous access of users in Beijing, Shanghai and Guangzhou. If you use your own network directly at this time, the measured data is like a joke.

To give a real example: last year there is a friend doing e-commerce, with Selenium to engage in price monitoring, the results are always the target site blocked IP, and then changed the dynamic residential IP, with selenium to engage in random access intervals, the success rate of data collection directly soared to 95% or more.

Second, hands-on teaching you in Selenium installed agent

Here to the guys the whole two commonly used programs, remember to choose the right one according to their business needs:

 Setting up a proxy for Chrome (unauthenticated version)
from selenium import webdriver

proxy = "123.123.123.123:8888" Replace here with the actual proxy address provided by ipipgo
chrome_options = webdriver.ChromeOptions()
chrome_options.add_argument(f'--proxy-server={proxy}')
driver = webdriver.Chrome(options=chrome_options)

 Proxy settings that require account authentication (focus here)
 Take ipipgo's TK line as an example, the format is username:password@IP:port.
from seleniumwire import webdriver This library needs to be installed additionally.

proxy_options = {
    'proxy': {
        
        'https': 'https://user123:pass456@gateway.ipipgo.net:24000', 'no_proxy': 'localhost,127
        'no_proxy': 'localhost,127.0.0.1' These addresses are not proxied
    }
}
driver = webdriver.Chrome(seleniumwire_options=proxy_options)

Watch out for potholes:A lot of people fall for the proxy protocol type. For example, ipipgo's TK line must use the Socks5 protocol, which has to be changed to the--proxy-server=socks5://IP:portThe write-up.

C. Agent Selection Guide for Different Business Scenarios

Here's a whole understandable table for you:

IV. Common rollover sites in actual combat

Case 1:Browser won't open after proxy setup
First check the proxy address for any typos, especially colons and port numbers. Brothers who use ipipgo client, it is recommended to first use theirOne Click DetectionThe function measures whether the proxy is in effect.

Case 2:Suddenly all requests time out
Eighty percent of the IP was pulled by the target site black. At this time to change ipipgo's dynamic residential IP, their IP pool automatically refreshed every 15 minutes, personally tested than manually change the IP to save a lot of trouble.

import requests

def refresh_proxy().
     Call ipipgo's API to get a new IP.
    api_url = "https://api.ipipgo.com/dynamic?token=你的令牌"
    new_proxy = requests.get(api_url).json()['proxy']
    return new_proxy