hutool set proxy ip: Hutool tool library HTTP request proxy IP configuration details

Top 3 scenarios for Hutool to set up a proxy IP

Folks do network requests with Java, Hutool's HttpUtil is really a saving tool. But when it comes to the need for proxy IP, many newbies are blind. Here are three typical scenarios:

1. Crawlers get their IPs blocked and have to work in a different armor.
2. Testing interface response in different geographies
3. Some special scenarios require hiding the real IP

Global Proxy Settings in Action

Let's start with the global configuration, which is suitable for scenarios where you need to use the proxy for a long time.After Hutool version 5.8, the way to set it up has become simpler. Look at this code:

GlobalHttpProxy.setProxy("114.220.23.4", 8080); // All subsequent requests automatically go to the proxy.
// All requests after that are automatically proxied
String res = HttpUtil.get("http://example.com");

Notice there's a pit here:If the proxy requires account password authenticationFor example, when using ipipgo's TK line, you have to use ProxyUtil to create a proxy object with authentication. For example, when using ipipgo's TK line:

Proxy proxy = ProxyUtil.getHttpProxy("tk01.ipipgo.com", 3128, "user", "pwd123");
GlobalHttpProxy.setProxy(proxy);

Single Request Proxy Configuration

Don't change the global configuration if you want to use a proxy temporarily. the HttpRequest object comes with a proxy method:

HttpRequest.get("https://target.site")
    .setProxy(new HttpProxy("122.226.1.5", 8888))
    .execute().body();

Here's a practical tip:Dynamically switching agent pools. Let's say you get a batch of IPs from ipipgo's API, you can poll them for use like this:

List proxyPool = loadFromIpipgoAPI(); // get the proxy pool from ipipgo
for(HttpProxy proxy : proxyPool){
    String result = HttpRequest.get(url).setProxy(proxy).execute().body(); // Process the business logic...
    // Process the business logic...
}

Common Pitfalls QA

Q: I set up a proxy but the request times out?
A: First check whether the proxy IP is available, it is recommended to use ipipgo'sDedicated Static IPPackages that are much more stable than shared pools

Q: What if I need to use more than one agent at the same time?
A: Use thread pool with proxy pool, each thread independently configure the proxy. ipipgo's API supports batch IP acquisition, remember to set a reasonable number of concurrency

Q: HTTPS request proxy failure?
A: Confirm that the agent supports SSL tunneling, ipipgo's cross-border dedicated line default support HTTPS/SOCKS5 protocol, encounter problems can find their technical customer service

Proxy Service Provider Selection Guide

Top 3 reasons to pick ipipgo:

1. The client comes with intelligent route switching, eliminating the need to write your own failover logic.
2. Supports flexible packages with hourly billing for short-term projects
3. Technical support is responsive and error logs can be thrown directly to them for analysis

Let's get real.

Don't trust those free proxies, nine out of ten are honeypots. Once I tested with a free IP and it was reverse crawled for business data. Now use ipipgo'sEnterprise-class dynamic residential IPThe company's products have been widely used in the market for a long time, with automatic authentication and security auditing functions, which saves a lot of heartache. Especially for those who do cross-border e-commerce, their cross-border line is really faster than ordinary agents by more than 30%.

Final Reminder:Be sure to do a connectivity test after setting up the proxy.. Use this method to test whether the proxy is in effect:

String checkUrl = "http://httpbin.org/ip";
String realIp = HttpUtil.get(checkUrl); // without proxy
String proxyIp = HttpRequest.get(checkUrl).setProxy(proxy).execute().body();
System.out.println("Real IP: " + realIp);
System.out.println("Proxy IP:" + proxyIp);