LinkedIn Dataset: B2B Contacts Database

What is the use of proxy IPs in LinkedIn data collection?

Friends doing foreign trade have been asking lately how to safely and efficiently get corporate contacts on LinkedIn. Directly take the crawler hard to dislike?Your account will be blocked in a minute.The first thing you need is a proxy IP to fight the battle. This is where proxy IPs are needed to fight the war of attunement, especially from providers like ipipgo who specialize in enterprise-level proxies.

To cite a real case: a cross-border e-commerce company wants to develop German machinery parts customers, the technology guy with a single IP continuous request LinkedIn API, the results triggered the wind control. Later changed to use ipipgo's dynamic residential agent.Automatic switching of 3-4 German local IPs per hour, the efficiency of data collection is directly doubled yet not blocked.

Three tricks to teach you to play proxy IP

First move:Masquerading as a real person in action. It is recommended to use residential proxies instead of server room IPs. ipipgo's residential IP library covers 200+ countries around the world, which is especially suitable for simulating real user locations.

import requests
proxies = {
    'http': 'http://user:pass@gateway.ipipgo.io:9021',
    'https': 'http://user:pass@gateway.ipipgo.io:9021'
}
response = requests.get('https://linkedin.com/api/data', proxies=proxies)

Second move:Request frequency should be like breathing.. Don't whole regularity request, refer to this random interval setting:

Third move:Don't let your fingerprints get in the way.. Remember to work with changing the User-Agent, ipipgo's browser fingerprinting plugin handles this automatically.