VBA Web Capture: Excel Automated Data Capture

Why is VBA always blocked for capturing web data? Try this method!

Old iron people use Excel to grab data is not often encountered this situation? Scripts run well on the sudden break, the web page prompts too frequent visits. At this time do not rush to smash the keyboard, eighty percent of your IP is the site stared at! Today we will teach the guys how to use the proxy IP this artifact, so that VBA capture stable as the old dog.

What's so black about proxy IP?

Simply put, it gives the network requestwear a maskIf you are a real person or a machine, you can change your identity every time you visit. For example, with ipipgo home services, can automatically switch between different regions of the IP address, the site can not tell whether you are a real person or machine. This trick against the anti-climbing mechanism is particularly effective, than the hard-headed wild refresh much stronger.

Sub Web Crawl With Proxy()
    Dim http As Object
    Set http = CreateObject("WinHttp.WinHttpRequest.5.1")

    ' Set the proxy server (to ipipgo for example)
    http.SetProxy 2, "http=45.123.123.123:8080" 'Here fill in the proxy address provided by the ipipgo

    http.Open "GET", "https://目标网站.com", False
    http.Send

    Debug.Print http.ResponseText
End Sub

Teach you VBA to connect to the proxy IP!

Here's the kicker! Adding proxies to code is actually extraordinarily simple:

1. Go to the ipipgo website and get a package (just use the pay-as-you-go for newbies)
2. Find the API interface address in the backend, it usually looks like this: http://账号:密码@gateway.ipipgo.com:端口
3. Slip the following line of code into your VBA script:

http.SetProxy 2, "http=gateway.ipipgo.com:31052"

First Aid Guidelines for Common Rollover Scenes

Q: What should I do if my proxy IP is not working?
A: 80% of the IP pool is used up, in the background of ipipgo turn on the "automatic replacement of IP" switch, set every 5 minutes to change a batch of new IP.

Q: Why does it slow down after adding a proxy?
A：可能节点没选对，ipipgo后台可以筛选低的机房。还有个冷知识：选和网站服务器同地区的代理节点，速度能快30%！

Q: What does code error 80072EFE mean?
A: This is usually a proxy configuration error, check the three elements: IP address, port, protocol type there is no copy error. If you can't figure it out, ipipgo's technical customer service responds quite quickly.

Why do you recommend ipipgo?

this oneDynamic Residential AgentsIt's really good! I have used seven or eight service providers, his IP survival time is long, unlike some service providers to give the IP with two minutes to hang. The point is that their support for automatic switching, no need to manually toss, especially suitable for us to hang up the collection of the scene.

Lastly, a word of advice: don't buy free proxies on the cheap, those IPs have long been blacked out by major websites. Spend a little money with ipipgo commercial level agent, save time are enough to eat two chickens. Remember, the key to stable collection isUse good proxies + control frequencyIf you do these two things right, data capture is as easy as picking up money!