Squidwarc

на сайте с December 16, 2022 12:32
High fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a headю Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head. Squidwarc aims to address the need for a high fidelity crawler akin to Heritrix while still being easy enough for the personal archivist to setup and use.