python3 urllib模块

最简单的栗子

1
2
3
import urllib.request
req = urllib.request.urlopen('http://www.baidu.com')
print(req.read().dedoce('urf-8'))

加入heander的栗子,我用的大众点评,因为访问大众点评需要加入heander,
方法见栗子。

1
2
3
4
req = urllib.request.Request("https://www.dianping.com/")
req.add_header('User-Agent','Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36')
reponse = urllib.request.urlopen(req)
print(reponse.read().decode('utf-8'))