python - pyspider scheduled crawling problem

Question

When I was writing the crawler, I found that after setting every in the code, after crawling once on the 21st, I saw that the result was not updated today, and the lastcrawltime was still on the 21st. Is my parameter setting incorrect?

Answer 1

The picture of the task you posted, what task is it for?

The task posted is detail_page

The questioner set a time for index_page that is less than the cronjob interval. However, detail_page is not set. In this way, detail_page will not be rescheduled

Project queue status, what are the recent active tasks?

Answer 2

It is possible that every and age do not match. If there is no problem with age, to be honest, this is a difficult disease. I often encounter it. I always go to taskdb to clear the corresponding table, then restart pyspider and re-run the project