PSpider

A simple web spider frame written by Python, which needs Python3.8+. Support multi-threading crawling mode (using threading) Support using proxies for crawling (using threading and queue) Define some utility functions and classes, for example: UrlFilter, get_string_num, etc