有了python3.6aiohttp,有没有一种方法可以获得我在发出请求时使用pycurl获得的以下所有数据。
name_lookup_time = curl_handle.getinfo(pycurl.NAMELOOKUP_TIME)
connect_time = curl_handle.getinfo(pycurl.CONNECT_TIME)
app_connect_time = curl_handle.getinfo(pycurl.APPCONNECT_TIME)
pre_transfer_time = curl_handle.getinfo(pycurl.PRETRANSFER_TIME)
start_transfer_time = curl_handle.getinfo(pycurl.STARTTRANSFER_TIME)
total_time = curl_handle.getinfo(pycurl.TOTAL_TIME)
redirect_time = curl_handle.getinfo(pycurl.REDIRECT_TIME)
redirect_cnt = curl_handle.getinfo(pycurl.REDIRECT_COUNT)
total_size = curl_handle.getinfo(pycurl.SIZE_DOWNLOAD)
目前,我在我的爬虫程序中使用pycurl multi实现来发出请求,然后我有代码来收集每个请求的详细数据。取代pycurl学习新东西。我有兴趣用aiohttp客户机实现替换pycurl多代码,该代码发出请求。
https://aiohttp.readthedocs.io/en/stable/client_reference.html#aiohttp.ClientResponse
)在文档中,我发现可以通过查看和计算ClientResponse对象的历史序列来获得重定向。
history
A Sequence of ClientResponse objects of preceding requests (earliest request first) if there were redirects, an empty sequence otherwise.
我可以不用大部分详细的时间数据。不过,我想收集我的最低要求的总时间和总大小。
