scrapy-pyppeteer

If you need browser integration for Scrapy, please consider using scrapy-playwright This project provides a Scrapy Download Handler which performs requests using Pyppeteer. It can be used to handle pages that require JavaScript. This package does not interfere with regular Scrapy workflows such as request scheduling or item processing.