Scrape genre pages

[kardeepakkumar]

Hey, have you tried adding a crawler for scraping the genre pages of goodreads, like: https://www.goodreads.com/shelf/show/war?page=1, I tried it, but it always goes for page 1 only. Even if I scrape on my terminal, I get first page only: content=$(curl -L goodreads.com/shelf/show/war?page=3)

I am new to scrapy.