What's an ASN number? First understand the logic of the ID card You should have seen the old iron ID card number, ASN number is the Internet Service Provider's "identity card number". Each carrier has its own ASN, such as China Telecom AS4134, mobile AS9808. this number is the global...

First, why use a proxy IP to send a request? When we use Python to capture data, we often get IP blocked by websites, right? For example, if you are monitoring the price of an e-commerce store or grabbing a limited number of products, you will be blacklisted in a minute if you use your real IP to make a crazy request. At this time, the proxy IP is like wearing a cloak, ...

ParseHub can't handle text validation? Teach you to use a proxy ip to break the game Recently, many brothers do data capture with me to complain, ParseHub that text validation more and more difficult to get. The first thing you need to do is to get a good deal on the phone, and you'll be able to get a good deal on the phone! Today we will break open the rubbing said, how to use the proxy i...

Teach you to use curl to check the proxy IP response header development partners must often encounter the need to check the server response header. Directly bare access to the target site is easy to expose the real IP not to mention, may also be intercepted by the anti-climbing mechanism. At this time the proxy IP will come in handy, today we will use ipipgo ...

Teach you to use Node.js to play around with proxy IP brothers engaged in network development understand, sometimes directly with their own IP request is particularly easy to be anti-climbing mechanism of the site stared at. This time to find a reliable proxy IP is like a program to wear a cloak of invisibility, today we take Node.js to give a chestnut, teach you how to ...

HTTP 403 error in the end is a what the hell? Crawlers or data collection partners should have seen this little demon - the browser suddenly popped up a 403 Forbidden prompt. Simply put, it means that the website treats you as a suspicious person, just like entering the neighborhood by the gatekeeper to prevent you from entering. This time...

What can proxy IP help you do when the website is madly bouncing CAPTCHA? Recently, a friend who does e-commerce complained to me, saying that the script of his family crawling price data is always the target website popping CAPTCHA. Artificial point CAPTCHA can still endure, machine program stuck in this on a complete hiatus. This situation is actually particularly common, t...

Browser Proxies: What do they do? Let's talk about the real people may have encountered this situation: logging in to the site always prompted anomalies, data collection is always blocked, multiple account operations on the block. At this time, the proxy IP is like a "face mask" for the browser, so that the site can not recognize you...

Engage in data collection must see! Playing with JSON and Proxy IP with Python Recently, some crawlers have been asking me what to do when the data is right in front of their eyes but is always intercepted by the website. Today, I'll teach you a trick - use Python to parse JSON with a proxy IP. this trick is especially suitable for the need for long-term stable data collection ...