python爬虫较为常用packages

CacheControl

CacheControl is a port of the caching algorithms in httplib2 for use with the requests session object.

It was written because httplib2’s better support for caching is often mitigated by its lack of thread-safety. The same is true of requests in terms of caching.