Spidr
на сайте с 15 декабря 2022, 14:04
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Spider a site, multiple domains, certain links or infinitely.