python - When using scrapy, why can the loop only get the first page?
黄舟
黄舟 2017-05-18 10:59:02
0
2
696

class OnlineSpider(scrapy.Spider):
name = "online"
allowed_domains = ["www.onlinedown.net"]
start_urls = ['http://www.onlinedown.net/new/android/','http://www.onlinedown.net/new/ios/','http://www.onlinedown.net/new/windows/']#
model = Model('onlinedown')

def start_request(self):
    for url in self.start_urls:
        for x in range(1, 100):
            detail_url = url + str(x) + '.html'
            print detail_url
            yield scrapy.Request(detail_url, callback = self.parse)
            

There are 35 items per page, and the result is 105 items. Why is this.

黄舟
黄舟

人生最曼妙的风景,竟是内心的淡定与从容!

reply all(2)
Ty80

How to write the parse function

漂亮男人

Where is your parse method?

Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template