刮网;无法传递字典中的所有项

使用字典列表来存储数据。

演示:

import requests
from bs4 import BeautifulSoup
base_url="http://cbcs.fastvturesults.com/student/1sp15me00"
res = []
for page in range(1,10,1):
    r=requests.get(base_url+str(page))
    c=r.content
    soup=BeautifulSoup(c,"html.parser")
    items=soup.find(class_="text-muted")
    if items:
        res.append({"Name": items.previous_sibling, "USN": items.text.replace("(","").replace(")","")})
print(res)

输出:

[{'USN': u'1sp15me001', 'Name': u'Agnello Fernandes A '}, {'USN': u'1sp15me002', 'Name': u'Ajay Kumar V '}, {'USN': u'1sp15me003', 'Name': u'Ajay Rajendiran '}, {'USN': u'1sp15me004', 'Name': u'Amit Singh Yadav '}, {'USN': u'1sp15me006', 'Name': u'Ankit Mahato '}, {'USN': u'1sp15me008', 'Name': u'Antony Levin Fernandez D '}, {'USN': u'1sp15me009', 'Name': u'Ashish S '}]

或者你开始的方式可能会以如下方式结束:

import requests
from bs4 import BeautifulSoup

base_url="http://cbcs.fastvturesults.com/student/1sp15me00{}"

data = []

for page in range(1,10,1):
    d = {}
    r = requests.get(base_url.format(page))
    soup = BeautifulSoup(r.content,"html.parser")
    items = soup.find(class_="text-muted")
    if items:
        d["Name"] = items.previous_sibling
        d["USN"] = items.text.replace("(","").replace(")","")
        data.append(d)

print(data)

输出:

[{'Name': 'Agnello Fernandes A ', 'USN': '1sp15me001'}, {'Name': 'Ajay Kumar V ', 'USN': '1sp15me002'}, {'Name': 'Ajay Rajendiran ', 'USN': '1sp15me003'}, {'Name': 'Amit Singh Yadav ', 'USN': '1sp15me004'}, {'Name': 'Ankit Mahato ', 'USN': '1sp15me006'}, {'Name': 'Antony Levin Fernandez D ', 'USN': '1sp15me008'}, {'Name': 'Ashish S ', 'USN': '1sp15me009'}]