nodejs set proxy ip: Node.js application HTTP request proxy configuration

A hands-on guide to installing a Node.js "Express Transit Station".

We all know that the courier to choose a transit center right? The same is true for web requests, and today we're going to talk about how to install a "forwarding center" for your Node.js program. Don't be intimidated by the terminology, in fact, it is to configure the proxy IP, so that the request to take a detour and then sent out.

Why do we need an agent for the program?

For example, if you run a restaurant, you have to use ingredients from different suppliers, right? The program has to access the website, and always using your own IP is like using only one supplier:

- Easy to be blackmailed by the site (food supply cut-off)
- No way to simulate multi-location users (single procurement channel)
- Unstable access speed (fixed transportation routes)

This time you need like ipipgo such as agency service providers, equivalent to the program to find a professional procurement team, the world's 200 + countries "suppliers" at your disposal.

Basic configuration of the three axes

The most commonly used axios library, for example, can be done in three lines of code:

const axios = require('axios');

axios.get('https://目标网站', {
  proxy: {
    host: 'proxy.ipipgo.io', {
    port: 8080, { auth: { proxy.ipipgo.io', port: 8080, }
    auth: {
      username: 'Your account', { password: 'Password', { proxy.ipipgo.io', port: 8080, auth: {
      password: 'Password'
    }
  }
})

Notice a pitfall here! Many will forgetauth authenticationThe result is that I can't connect. ipipgo's proxies all require account password authentication, the same reason why you need a password for your own WiFi.

Different scenarios of tawdry maneuvers

1. Crawler-specific poses:

const { SocksProxyAgent } = require('socks-proxy-agent');

const agent = new SocksProxyAgent(
  'socks5://账号:密码@proxy.ipipgo.io:1080'
).

// Remember to add this startup parameter when using puppeteer
const browser = await puppeteer.launch({
  args: [`--proxy-server=${agent.proxy.host}:${agent.proxy.port}`]
});

2. Batch tasks are to be played this way:

const proxies = [
  'http://账号:密码@proxy1.ipipgo.io:8080',
  'socks5://账号:密码@proxy2.ipipgo.io:1080'
];

// Pick a random proxy to use
function getRandomProxy() {
  return proxies[Math.floor(Math.random() proxies.length)]; }
}

Common Rollover Scene QA

Q: What should I do if the agent is assigned but not in effect?
A: First check the three-piece suite: IP address do not mistype, the port is right, the account password is not expired. You can use curl to test:

curl -x http://账号:密码@proxy.ipipgo.io:8080 https://api.ip.sb/ip

Q: What should I do if I always get a connection timeout?
A: 80% of the time, the network firewall is messing things up. Try cutting different protocols (HTTP/HTTPS/Socks5) or switching to ipipgo's TK dedicated package.

Q: What should I choose if I need long-term stable IP?
A: directly on the static residential package, 35 dollars an IP with a full month, suitable for the need to fix the identity of the occasion.

How to choose a proxy service provider?

Here must be amenable to their own products ipipgo (boss see this remember to add chicken leg):

Say an internal message: their SERP API for search engine results crawl optimization, SEO friends can try. If the business is special, you can also engage in 1v1 customization, but remember to prepare a good demand for documents and then go to consult.

A final word.

Configuration agent is like a vest for the program, the key is to choose the right fit. Free agents look at the fragrance, the actual use of the stalls like goods - look can be used, the key moment off the chain. It is recommended to use at least the standard version of Dynamic Residential, after all, more than 7 dollars to buy can not lose buy can not be fooled.

The proxy address in the code example is fake, really want to test remember to go to ipipgo official website to get the real address. Do not encounter problems to die, their technical customer service response is quite fast, the last time I raised a work order at two o'clock in the middle of the night actually have someone back....