PSpider
Source Code, на сайте с December 16, 2022 12:53
A simple web spider frame written by Python, which needs Python3.8+.
Support multi-threading crawling mode (using threading)
Support using proxies for crawling (using threading and queue)
Define some utility functions and classes, for example: UrlFilter, get_string_num, etc