How do I scrape a page which uses AJAX for pagination (Infinite scrolling) in Scrapy?Answer (1 of 2): My first recommendation is to always look at the rendered page without javascript, that is, how Scrapy will see the content (without selenium etc), and in this case it seems to work since they have a classical pagination if the browser doesn't support Javascript. If you look at ...
