您在页面上看到的数据是通过JavaScript从外部URL加载的,因此您可以直接从那里获取数据:
import pandas as pd
import requests
url = "https://immi.homeaffairs.gov.au/_layouts/15/api/data.aspx/GetPriceList"
data = requests.post(url, json={"category": "Visa", "onshore": "All"}).json()
df = pd.DataFrame(data["d"]["data"])
df.pop("note")
print(df.head(5))
打印:
visaSubclassCode visaSubclassText streamCode streamText onShore basePrice over18Price under18Price nonInternetPrice subsequentPrice
0 100 Partner (Provisional and Migrant) visa (subclass 309/100) No AUD8,850.00 AUD4,430.00 AUD2,215.00 N/A N/A
1 101 Child visa (subclass 101) No AUD3,055.00 AUD1,530.00 AUD765.00 N/A N/A
2 102 Adoption visa (subclass 102) No AUD3,055.00 AUD1,530.00 AUD765.00 N/A N/A
3 117 Orphan Relative visa (subclass 117) No AUD1,870.00 AUD935.00 AUD470.00 N/A N/A
4 124 Distinguished Talent visa (subclass 124) No AUD4,110.00 AUD2,055.00 AUD1,030.00 N/A N/A