Python yfinance to get fund ups and downs: proxy IPs to bypass restrictions

When fund data capture gets in the way? Try this "change of armor" trick

Recently, a lot of friends are asking, using Python's yfinance library to grab fund data is always intercepted. In fact, this has something to do with the website setThreshold for frequency of visitsIt's like the supermarket limit of three bottles of Moutai per day for the same face.change of armorEntry.

A real-life scenario of "chain locks."

Last week a customer fell into this: the automation script he wrote was running and suddenly reported a 403 error. I looked at the logs, and it was the same IP address!Sent over 200 requests in 5 minutes.The servers are directly blacklisted. It's like buying a hundred lottery tickets in a row with the same ID, who do you check if not you?

import yfinance as yf

 Conventional way of writing
fund = yf.Ticker("000001.SS")
print(fund.history(period="1mo")) Here you may get an error suddenly

The wonders of dynamic IP pools

That's when it's time toProxy IP Serviceto unravel the situation. Take ipipgo's service, their dynamic IP pool has two major tricks up its sleeve:

For example, we can change the code to look like this:

import requests
from yfinance import shared

def get_proxy().
     Here we use the ipipgo API to get the dynamic proxy
    return {"http": "http://用户名:密码@gateway.ipipgo.com:9020"}

fund = yf.Ticker("000001.SS")
fund._session.proxies = get_proxy()
data = fund.history(interval="1h")

Three Key Points for Configuring Agents

1. Be flexible with timeout settings: It is recommended to set it to 3-5 seconds to automatically cut the next IP in case of lagging
2. High Stash Mode is a must!: ipipgo's deep anonymizing proxy hides real fingerprints
3. Failure Retry Mechanism: It is recommended to set up 3 retries, with different IPs in between.

Frequently Asked Questions QA

Q: What should I do if the proxy IP is not working?
A: It is recommended to use ipipgo'sIntelligent Fusing MechanismThe system automatically rejects failed nodes.

Q: Data requests always time out?
A: Check the proxy locale settings and try to selectnorth, Shanghai, Guangzhou and Shenzhennodes with more stable network quality

Q: How can I tell if a proxy is in effect?
A: Add a debug statement to the code to print the exit IP for each request:

response = requests.get("http://ip.ipipgo.com", proxies=proxy)
print(f "Current exit IP: {response.text}")

Guide to avoiding the pit

It was recently discovered that someone using a free proxy causeddata leakIt's really not worth it. ipipgo'sEnterprise-class encrypted tunnelsIt's not the same, full HTTPS transmission and traffic obfuscation. Don't lose all your family money just to save a few cents, don't you think so?

As a final nag, when setting up the proxy remember to put theUser authentication parametersPut it in an environment variable, don't be stupid and write the account password to death in the code. It's like sticking your house key in the lock, isn't it just waiting to be stolen?