|
一、用urllib.request,opener模拟请求头
import urllib.request
#模拟请求头headers
url = "https://www.csdn.net/"
# 注意:此处的headers要写为一个元组类型才可以。写为字典类型的话会报错!
headers = ("user-agent","Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36")
#添加请求头
opener = urllib.request.build_opener()
opener.addheaders = [headers]
data = opener.open(url).read().decode("utf-8")
print(data)
二、用requests模拟请求头
import requests
url = "https://www.csdn.net/"
headers = {"user-agent":"Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36"}
r = requests.get(url,headers=headers)
print(r.text)
感觉用requests处理更加通俗便捷。 |