Crawler Fingerprinting Hiding Tips: A Guide to Fixing Canvas/WebGL Vulnerabilities

Crawler engineers' biggest browser fingerprinting headache

The old iron engaged in data collection should have stepped on this pit - obviously changed the IP, clear cookies, the target site can still accurately identify the crawler. This thing is eighty percent of the browser fingerprinting trouble, especially Canvas and WebGL, the two hardest hit areas. Just like you go to the supermarket wearing a mask, the results of people through your walking posture recognized the same, the site can be through the graphics card model, rendering accuracy of these hardware features to lock the device.

Canvas fingerprint leakage analysis

As a chestnut, when your crawler visits a website, the browser silently executes this JS code:

var canvas = document.createElement('canvas');
var ctx = canvas.getContext('2d');
ctx.fillStyle = 'rgb(160,160,160)'; var ctx.fillRect(0,100,100,100)
ctx.fillRect(0,0,100,100); ctx.fillStyle = 'rgb(160,160,160)'; ctx.fillRect(0,0,100,100); ctx.fillRect(0,0,100,100)

Just these few lines of code can generateGlobally unique graphical hashThe rendering effect of devices with different graphics card drivers and operating system versions are all slightly different. Last year, a customer used a single server to hang 200 proxy IPs to capture data, and the result was all blocked, because it did not deal with this fingerprint.

ipipgo dynamic ip crack

The programs we design for our clients arelit. paint holding two brushes (idiom); fig. to work on two tasks at the same time::

Focusing on the IP part, ipipgo'sDynamic Residential AgentsThere is a masterpiece - each request automatically matches the local real user's Internet time. For example, if you want to capture data from Shanghai, you can use Xuhui Telecom IP at 8:00 a.m., and cut to Pudong Mobile IP at 10:00 a.m., so that the IP segments and work and rest times match the real users perfectly.

Must-have fingerprint modification codes

Here's a tried and tested trick that works, add these lines to Puppeteer:

await page.evaluateOnNewDocument(() => {
  const getParameter = WebGLRenderingContext.prototype.getParameter;
  WebGLRenderingContext.prototype.getParameter = function(parameter) {
    if (parameter === 37445) { // 显卡ID参数
      return 'Intel HD Graphics 620';
    }
    return getParameter.apply(this, [parameter]);
  };
});

Remember to pair it with ipipgo'sIP Rotation Interfaceuse, their API supports automatic IP replacement by number of requests, which is more accurate than traditional switching by the minute.

A guide to avoiding the pitfalls of the white man

Three common mistakes newbies make:

1. Only changing IPs without changing fingerprints (equivalent to changing vests without changing walking positions)
2. Use a data center proxy (too obvious a feature)
3. Switching frequency too regular (machine behavioral characteristics)

There is an e-commerce comparison of the customer, the original hourly IP change 1 time, changed to use ipipgoRandom switching modeAfter (5-15 min randomized intervals), acquisition success spiked from 371 TP3T to 891 TP3T.

Frequently Asked Questions QA

Q: How do I detect if my fingerprints are leaking?
A: Visit the fingerprint detection tool on the ipipgo website to see more than 20 fingerprint parameters such as Canvas/WebGL.

Q: Do I need to maintain the residential proxy IP myself?
A: No need at all, ipipgo's proxy pool comes with a 5-minute automatic cleanup mechanism, and each IP will go back to the pool for refreshing if it is used at most 3 times.

Q: Does dynamic IP affect crawler speed?
A: Tested using their API3.0 version, the million requests processing speed is 40% faster than the traditional proxy, because of the built-in intelligent routing optimization.

Finally, a cold one: nowadays many websites will put IP and fingerprintscombination markerEven if you change your IP address, your fingerprints will still be recognized as long as they remain the same. It is recommended to use ipipgo directly.多协议代理服务, supports modifying HTTP/Socks5 communication fingerprints at the same time, which is the real stealth mode.